heavy tail

A distribution where a small share of items are far larger or slower than the rest.

In more detail

Real request costs are often heavy-tailed, which is exactly when simple round robin breaks down and load-aware balancing pays off. The mean of a heavy-tailed distribution is dominated by a few extreme values.

Related terms

Taught in

References