ingest lag
The delay between a data point being produced and it becoming queryable.
In more detail
Set a maximum for alerting data and measure it, because a pipeline can be running while its alerts arrive too late to matter. It is the pipeline equivalent of consumer lag.
Related terms
- consumer lag — How many records a consumer group has not yet committed on a partition: the log end offset minus the committed offset.
- ingestion — Accepting incoming data and getting it safely into storage.
Taught in
- Worked Design Three: A Metrics Ingestion Pipeline — Scalable System Design & Distributed Architecture