overload
More work arriving than a system can complete in time.
In more detail
Overload makes systems slower rather than merely busier: lock waits lengthen, retries multiply and pools fill. Plan what to refuse before it happens.
Related terms
- load shedding — Deliberately rejecting some requests when overloaded so the requests that are accepted can still be served well.
- admission control — Deciding at the entrance whether a request may start, based on how much work the system can still take.
- overload collapse — A drop in useful throughput caused by accepting more work than a system can handle.
Taught in
- Partitioning, Sharding And Hot Keys — Scalable System Design & Distributed Architecture
- Load Balancing And The Failure Modes It Introduces — Scalable System Design & Distributed Architecture
- Retries, Backoff And Jitter — Scalable System Design & Distributed Architecture
- Backpressure And Load Shedding — Scalable System Design & Distributed Architecture
- Worked Design One: Scaling The Ticket Booking System — Scalable System Design & Distributed Architecture
- Worked Design Three: A Metrics Ingestion Pipeline — Scalable System Design & Distributed Architecture