hit ratio
The share of requests a cache answers itself without going to the origin.
In more detail
The rest of a caching design follows from this number. Latency changes gently as it falls, but origin load does not: dropping from 99 to 90 percent multiplies origin traffic by ten. Measure it over a whole week, not a good hour.
Example
At 20,833 reads a second, 99 percent hits leave about 200 reads a second for the origin; 90 percent leave about 2,000.Related terms
- miss rate — The share of requests a cache cannot answer, which all go on to the origin.
- origin server — The server that actually holds the content or runs the application, as opposed to a proxy or cache in front of it.
- cache — A store of earlier answers kept close to where they are needed so they can be reused instead of fetched or computed again.
Taught in
- Back Of The Envelope Estimation: Storage And Bandwidth — Scalable System Design & Distributed Architecture
- Caching Strategies And Topology — Scalable System Design & Distributed Architecture
- Load Balancing And The Failure Modes It Introduces — Scalable System Design & Distributed Architecture