token bucket
A rate limiting algorithm in which requests spend tokens from a bucket that refills at a steady rate, allowing short bursts up to the bucket size.
In more detail
Each request takes a token, and requests are rejected when the bucket is empty. It smooths traffic while still tolerating brief spikes.
Related terms
- rate limiting — Capping how many requests a client may make in a period of time, and rejecting or delaying the rest.
- burst — A short spike of many requests or messages at once, as opposed to the average rate over time.
Taught in
- Built-in Rate Limiting Middleware — Modern .NET Core, C# & Enterprise Microservices