fan-out
Sending one request or message on to many recipients or services at once.
In more detail
A request that fans out is only fast if every branch is fast, so fan out multiplies tail latency. In messaging, fan out is delivering one message to every member of a group, which can be done when the message is written or when it is read.
Related terms
- tail latency — The latency of the slowest requests, measured by high percentiles such as p99.
- fan out on write — Copying a new message into every recipient's feed or inbox at the moment it is written.
- fan out on read — Storing a message once and assembling each recipient's view only when they open it.
- hybrid fan out — Choosing fan out on write for small audiences and fan out on read for very large ones.
Taught in
- Requirements: The Constraints That Shape The System — Scalable System Design & Distributed Architecture
- Back Of The Envelope Estimation: Traffic And Throughput — Scalable System Design & Distributed Architecture
- Latency Numbers Every Engineer Should Know — Scalable System Design & Distributed Architecture
- Partitioning, Sharding And Hot Keys — Scalable System Design & Distributed Architecture
- Eventual Consistency And What It Costs A Product — Scalable System Design & Distributed Architecture
- Retries, Backoff And Jitter — Scalable System Design & Distributed Architecture
- Observability As A Design Input — Scalable System Design & Distributed Architecture
- Worked Design Two: Scaling Chat Fan Out — Scalable System Design & Distributed Architecture