burst
A short spike of many requests or messages at once, as opposed to the average rate over time.
In more detail
Rate limits often allow a small burst above the sustained rate. Queues absorb bursts so workers can process at a steady pace.
Related terms
- rate limiting — Capping how many requests a client may make in a period of time, and rejecting or delaying the rest.
- quota — A total allowance of use over a long period, such as a number of requests per day or month.
- message queue — A store that holds messages from producers until consumers are ready to process them, decoupling the rate of arrival from the rate of work.
- fixed window — A rate-limiting method that counts requests in fixed blocks of time, such as two per second, resetting the count when each block ends.
- token bucket — A rate limiting algorithm in which requests spend tokens from a bucket that refills at a steady rate, allowing short bursts up to the bucket size.
Taught in
- Rate Limiting Strategies — Modern API Architecture: REST, GraphQL & gRPC
- Event-Driven Architecture And Queues — Modern API Architecture: REST, GraphQL & gRPC
- Built-in Rate Limiting Middleware — Modern .NET Core, C# & Enterprise Microservices