thundering herd

A flood of requests that arrives at once when many clients react to the same event, such as all retrying after an outage.

In more detail

It can knock over a service that was just recovering. Backoff with jitter, retry limits and rate limiting all spread the load out.

Related terms

Taught in

References