hedged request
Sending a second copy of a slow request to another server and using whichever answer arrives first.
In more detail
Hedging cuts tail latency in wide fan out designs at the cost of some extra load. It is only safe for idempotent requests.
Related terms
- tail latency — The latency of the slowest requests, measured by high percentiles such as p99.
- fan-out — Sending one request or message on to many recipients or services at once.
- idempotency — The property of an operation that gives the same result whether you run it once or many times, because a repeat run finds nothing left to do.
Taught in
- Latency Numbers Every Engineer Should Know — Scalable System Design & Distributed Architecture