queueing theory
The mathematics of waiting lines, describing how arrival rates and service times produce delay.
In more detail
Two results carry most system design: waiting grows as one over one minus utilisation for a single busy server, and Little's law links queue length, arrival rate and time. It explains why systems run near full utilisation have long, unpredictable waits.
Related terms
- Little's law — A rule from queueing theory: average lead time equals average work in progress divided by average throughput.
- knee of the curve — The point where a small rise in load starts causing a large rise in waiting time.
- queueing — Waiting in line for a busy resource, such as a thread, connection or disk.
Taught in
- Queues, Events And Asynchronous Work — Scalable System Design & Distributed Architecture