enable.auto.commit
The consumer setting that, when true, commits offsets automatically on a background timer.
In more detail
It is on by default and commits every five seconds in kafka-python. That is convenient but can commit records before you have finished processing them, so the course turns it off and commits manually.
Example
KafkaConsumer(enable_auto_commit=False)Related terms
- manual offset commit — Committing a consumer's offsets by calling commit in your own code instead of relying on the automatic timer.
- committed offset — The offset a consumer group has saved on the broker for a partition, marking the next record it should read after a restart.
- at-most-once delivery — A delivery guarantee in which each message is processed once or not at all, never twice.
Taught in
- The Payment That Was Charged Twice — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Too Slow Between Two Polls — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Eleven Thousand Scans That Never Arrived — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Seventy One Percent — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Committing Offsets: Auto, Manual And Lag — Apache Kafka & Event Streaming
- At Most Once, At Least Once — Apache Kafka & Event Streaming
- Watching Lag And Sizing Partitions — Apache Kafka & Event Streaming