headroom
Capacity kept free above the expected peak, so the system survives deployments, spikes and failures.
In more detail
Headroom pays for losing machines on purpose during a rolling deployment, for retry storms, and for losing a whole zone. Because queueing delay rises steeply near full utilisation, headroom is not waste but the price of acceptable latency.
Related terms
- utilization — The fraction of time a resource is busy.
- failure domain — A group of components that can fail together because they share something, such as a rack, power supply or zone.
- capacity planning — Estimating how much computing capacity a system will need and when, so it is there before the load arrives.
- knee of the curve — The point where a small rise in load starts causing a large rise in waiting time.
Taught in
- Back Of The Envelope Estimation: Traffic And Throughput — Scalable System Design & Distributed Architecture
- Back Of The Envelope Estimation: Storage And Bandwidth — Scalable System Design & Distributed Architecture
- Latency Numbers Every Engineer Should Know — Scalable System Design & Distributed Architecture
- Load Balancing And The Failure Modes It Introduces — Scalable System Design & Distributed Architecture
- Capacity Planning As A Design Input — Scalable System Design & Distributed Architecture