headroom

Capacity kept free above the expected peak, so the system survives deployments, spikes and failures.

In more detail

Headroom pays for losing machines on purpose during a rolling deployment, for retry storms, and for losing a whole zone. Because queueing delay rises steeply near full utilisation, headroom is not waste but the price of acceptable latency.

Related terms

Taught in

References