log segment
One file in the series of files that together make up a partition's log on disk.
In more detail
The broker writes only to the newest, active segment and closes it when it reaches a size or age limit. Retention and compaction work on closed segments, which is why deletion happens a segment at a time.
Related terms
- retention — How long data such as backups, logs or snapshots is kept before it is deleted.
- segment.bytes — The topic property that sets the maximum size of one log segment file before the broker closes it and starts a new one.
- log compaction — A cleanup mode in which the broker keeps at least the latest record for every key and removes older records with the same key.
- append-only log — A data structure where new entries are only ever added at the end and existing entries are never changed in place.
Taught in
- The Error Storm That Fixes Itself — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Retention Deletes Files, Not Records — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Two Copies Of One Service — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Forty Minutes To Count Again — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- The Certificate That Expired On A Sunday — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Forty Minutes To Start — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Full Disks On Black Friday — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Retention: Time, Size And Why Data Stays — Apache Kafka & Event Streaming
- Log Compaction: A Topic As A Table — Apache Kafka & Event Streaming
- When Kafka Is The Wrong Tool — Apache Kafka & Event Streaming