high watermark
The offset one past the last record that every in-sync replica has copied, which is as far as consumers are allowed to read.
In more detail
On a partition written from offset zero with nothing deleted, the high watermark equals the number of records written. rpk topic describe -p prints it for each partition. A high watermark of zero means the partition is empty.
Related terms
- offset — The permanent position number of a record inside its partition, starting at zero and increasing by one for each record.
- log end offset — The offset that the next record written to a partition will receive, one more than the offset of the newest record.
- in-sync replica set — The replicas of a partition that are currently caught up with the leader, abbreviated ISR.
- rpk topic describe — An rpk command that shows a topic's summary, its configuration with -c, or its partition table with -p.
Taught in
- Acknowledged Is Not Always Safe — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- The Error Storm That Fixes Itself — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Two Copies Of One Service — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Eleven Thousand Scans That Never Arrived — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Topics, Partitions And Where A Record Lands — Apache Kafka & Event Streaming
- Batching, Linger And Throughput — Apache Kafka & Event Streaming
- Duplicates Are The Default — Apache Kafka & Event Streaming
- Dual Writes And Why They Lose Data — Apache Kafka & Event Streaming
- Log Compaction: A Topic As A Table — Apache Kafka & Event Streaming