working set
The portion of data a system actively uses over a period, which ideally fits in memory.
In more detail
When the working set no longer fits in one machine's memory, reads fall to disk and latency jumps. That is one of the signals that it is time to scale horizontally or partition.
Related terms
- memory — The fast, temporary working space where running programs keep their data; it is emptied when the machine powers off.
- buffer pool — Memory a database uses to keep recently read disk pages, so it does not reread them from disk.
- partitioning — Splitting a dataset into separate pieces, each owned by a different machine or process, so the work can spread out.
Taught in
- The Storage Decision: Relational Versus Document — Scalable System Design & Distributed Architecture
- Partitioning, Sharding And Hot Keys — Scalable System Design & Distributed Architecture
- Capacity Planning As A Design Input — Scalable System Design & Distributed Architecture