tail latency

The latency of the slowest requests, measured by high percentiles such as p99.

In more detail

Users often feel the tail more than the average, and one slow dependency in a chain of calls pushes more requests into it. Queueing, garbage collection pauses and lock contention are common causes.

Examples

A page that makes 20 requests meets the slowest 1 per cent about 18 per cent of the time.
If one call in a hundred is slow, a request that fans out to a hundred calls is slow about 63 percent of the time.
In this course: A fast average with a growing tail is a warning sign. The tail is what real users feel on a bad request, so it is usually what a service objective should promise.

Related terms

Taught in

References