token bucket

A rate limiting algorithm in which requests spend tokens from a bucket that refills at a steady rate, allowing short bursts up to the bucket size.

In more detail

Each request takes a token, and requests are rejected when the bucket is empty. It smooths traffic while still tolerating brief spikes.

Related terms

Taught in

References