load shedding

Deliberately rejecting some requests when overloaded so the requests that are accepted can still be served well.

In more detail

Serving some users well is better than serving everyone badly. Shed requests get a fast error, often 429 or 503, instead of a slow timeout.

Example

An open circuit breaker sheds load from a failing dependency.

Related terms

Taught in

References