time bucket
A fixed window of time, such as an hour, used to group records in a key.
In more detail
Adding a time bucket to a partition key spreads writes and lets old buckets be compacted, downsampled or deleted as a whole. Bucket size is a trade-off between spreading writes and keeping recent queries local.
Related terms
- compound key — A key built from two or more fields, such as tenant plus time bucket.
- downsampling — Replacing detailed old data with coarser summaries, such as one value per hour instead of per ten seconds.
- tiered retention — Keeping recent data in fast storage and older data in cheaper, slower, often downsampled storage.
Taught in
- Partitioning, Sharding And Hot Keys — Scalable System Design & Distributed Architecture
- Worked Design Three: A Metrics Ingestion Pipeline — Scalable System Design & Distributed Architecture