baseline
A reference measurement that later measurements are compared against.
In more detail
A comparison without a baseline cannot say whether a change made things better or worse. In a canary release, the version already running is the baseline and the canary is judged by how far its signals drift from it.
Example
DORA advises starting with a rough baseline and a conversation before building precise metric integrations.Related terms
- canary release — Sending a small share of real traffic to a new version first, and increasing it only while its metrics stay healthy.
- benchmark — A repeatable measurement of how long code takes, or how much it uses, under a fixed workload, or more broadly a standard point of comparison such as an industry average.
Taught in
- The Pitfalls Of Measurement — DevOps & Site Reliability Engineering
- Deployment Strategies: Canary Releases — DevOps & Site Reliability Engineering
- Decoupling Release From Deployment: Feature Flags — DevOps & Site Reliability Engineering