heavy tail
A distribution where a small share of items are far larger or slower than the rest.
In more detail
Real request costs are often heavy-tailed, which is exactly when simple round robin breaks down and load-aware balancing pays off. The mean of a heavy-tailed distribution is dominated by a few extreme values.
Related terms
- tail latency — The latency of the slowest requests, measured by high percentiles such as p99.
- round robin — A way of spreading work by taking turns in a fixed order, giving the next item to the next recipient in the list.
Taught in
- Load Balancing And The Failure Modes It Introduces — Scalable System Design & Distributed Architecture