mass expiry
Many cache keys expiring at the same moment because they were written together with the same time to live.
In more detail
Bulk loads and deploys write keys together, so they die together and the origin sees one big spike. Adding random jitter to each TTL spreads the refills without changing the total work.
Related terms
- TTL — How long a stored item, such as a session, token or cache entry, stays valid before it expires.
- jitter — A random amount added to or taken from a retry delay so that many clients do not all retry at the same moment.
- thundering herd — A flood of requests that arrives at once when many clients react to the same event, such as all retrying after an outage.
Taught in
- Cache Invalidation And The Three Hard Cases — Scalable System Design & Distributed Architecture