latency budget

A latency target divided among the hops a request makes, so each part knows how much time it may spend.

In more detail

Build it by subtraction from the user promise: list each hop, add up the costs, and see which hop to attack. Budget at the tail, not at typical numbers, and leave a margin for variance.

Example

200 ms budget: load balancer 1, app work 20, cache read 1, database read 8, cross region call 80.

Related terms

Taught in

References