bounded concurrency

Capping how many requests a caller will have in progress to a dependency at once.

In more detail

It stops a slow dependency from consuming every worker and turns overload into fast, explicit refusals. Requests beyond the limit are queued briefly or refused quickly.

Related terms

Taught in

References