Kafka cluster
A group of brokers that share the same topics and metadata and act as one Kafka service.
In more detail
Clients connect to any broker, learn the cluster layout from its metadata, and then talk directly to the partition leaders. Adding brokers spreads partitions and their copies across machines for capacity and fault tolerance. The course starts with a single-node cluster and moves to three brokers in module seven.
Related terms
- broker — A server that receives messages from producers, stores them and delivers them to consumers, such as RabbitMQ or Apache Kafka.
- replication — Keeping copies of data in more than one place, updated automatically, so one failure does not lose or block it.
- Kafka controller — The broker currently responsible for cluster-wide decisions such as tracking brokers and choosing partition leaders.
- metadata — Data that describes other data, such as a file name, a creation time or a package version.
Taught in
- Where Is The Password Kept? — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Full Disks On Black Friday — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Starting A Broker And Reading Its Metadata — Apache Kafka & Event Streaming
- Three Brokers: Replication And Leaders — Apache Kafka & Event Streaming
- When Kafka Is The Wrong Tool — Apache Kafka & Event Streaming