downsampling
Replacing detailed old data with coarser summaries, such as one value per hour instead of per ten seconds.
In more detail
It makes long-range queries and long retention affordable at the cost of detail. The product should show when data has been downsampled.
Related terms
- tiered retention — Keeping recent data in fast storage and older data in cheaper, slower, often downsampled storage.
- time series — A sequence of timestamped values for one metric name with one exact set of label values.
- retention — How long data such as backups, logs or snapshots is kept before it is deleted.
Taught in
- Worked Design Three: A Metrics Ingestion Pipeline — Scalable System Design & Distributed Architecture
- Worked Design Three: Scaling The Metrics Pipeline — Scalable System Design & Distributed Architecture