power of two random choices

A load balancing method that picks two backends at random and sends the request to the less busy one.

In more detail

It performs nearly as well as checking every backend while needing no shared state, which makes it robust across many independent balancers. Envoy calls it least request.

Related terms

Taught in

References