load balancer

A server that spreads incoming requests across several copies of a service so no single copy is overloaded.

In more detail

Stateless requests let it send each request to any healthy copy without sticky sessions. It checks the health of each copy and stops sending traffic to ones that fail.

Examples

In AWS: A service that receives connections at one stable address and spreads them across several healthy servers behind it.
It keeps a pool of backends, picks one for each request or connection with an algorithm such as round robin or least connections, and runs health checks to skip backends that fail. A transport-layer balancer sees only connections; an application-layer balancer reads HTTP requests and can terminate TLS. It is itself an intermediary, so trace the client-to-balancer and balancer-to-backend legs separately.
algo=rr req=42 be=app-a ok=y shows a balancer choosing a healthy backend by round robin.

Related terms

Taught in

References

Certification courses