load balancing

Spreading requests or connections across several backend servers so no single one is overloaded and failed ones can be avoided.

In more detail

A load balancer picks a backend for each request using an algorithm such as round robin or least connections, and uses health checks to decide which backends are eligible. It can work at the transport layer, seeing only connections, or at the application layer, seeing HTTP requests. Uneven traffic often comes from affinity or long-lived connections rather than a broken algorithm.

Example

In Kubernetes only ready pods receive traffic.

Related terms

Taught in

References