in flight
Started but not yet finished, such as requests currently being processed.
In more detail
Work in flight consumes memory, connections and attention. Bounding it is the core of backpressure and admission control.
Related terms
- bounded concurrency — Capping how many requests a caller will have in progress to a dependency at once.
- admission control — Deciding at the entrance whether a request may start, based on how much work the system can still take.
Taught in
- Replication, Failover And Leader Election — Scalable System Design & Distributed Architecture
- Cache Invalidation And The Three Hard Cases — Scalable System Design & Distributed Architecture
- Backpressure And Load Shedding — Scalable System Design & Distributed Architecture