partition
One slice of a larger dataset or message stream, owned and processed independently of the others.
In more detail
In a database a partition owns a range or hash bucket of keys; in a log, a topic is split into partitions for parallel consumers. Ordering and fast local queries exist inside one partition only, and parallelism is capped by the partition count.
Related terms
- partitioning — Splitting a dataset into separate pieces, each owned by a different machine or process, so the work can spread out.
- partition key — The DynamoDB attribute whose value decides which storage partition an item lives in, and which every query must name.
- topic — A named channel in a publish-subscribe messaging system that producers write to and any number of subscribers read from.
- hot partition — A partition that gets far more traffic than the others because many requests use the same key, causing throttling even when total capacity is free.
Taught in
- Compute Performance: Families, Placement And Lambda Memory — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Database Performance: Caches, Proxies And Capacity Units — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Ingest And Transform: Streams, Lakes And Partitions — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- The Performance Clinic: Five Slow Systems, Five Fixes — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Replication, Failover And Leader Election — Scalable System Design & Distributed Architecture
- Partitioning, Sharding And Hot Keys — Scalable System Design & Distributed Architecture
- Consistency, And The Truth About CAP — Scalable System Design & Distributed Architecture
- The Difference Between A Queue And A Log — Scalable System Design & Distributed Architecture
- Worked Design One: Scaling The Ticket Booking System — Scalable System Design & Distributed Architecture
- Worked Design Two: Scaling Chat Fan Out — Scalable System Design & Distributed Architecture
- Worked Design Three: A Metrics Ingestion Pipeline — Scalable System Design & Distributed Architecture
- Worked Design Three: Scaling The Metrics Pipeline — Scalable System Design & Distributed Architecture