power of two random choices
A load balancing method that picks two backends at random and sends the request to the less busy one.
In more detail
It performs nearly as well as checking every backend while needing no shared state, which makes it robust across many independent balancers. Envoy calls it least request.
Related terms
- least connections — A load-balancing algorithm that sends each new request to the backend currently handling the fewest active connections.
- round robin — A way of spreading work by taking turns in a fixed order, giving the next item to the next recipient in the list.
Taught in
- Load Balancing And The Failure Modes It Introduces — Scalable System Design & Distributed Architecture