max.in.flight.requests.per.connection
The producer setting for how many unacknowledged requests may be outstanding on one broker connection at the same time.
In more detail
Allowing several in flight raises throughput, but retries can then reorder records unless idempotence is on. kafka-python 2.2 requires this to be 1 for idempotent mode; the Java client and newer kafka-python releases allow up to five.
Related terms
- idempotent producer — A producer mode in which the broker detects and discards duplicate batches caused by retries, so each record is written once per partition.
- ordering guarantee — A promise about whether messages are processed in the order they were sent, which is often limited to one key or partition.
- retry — Sending a request again after it failed or timed out, in the hope that it succeeds the second time.
Taught in
- The Retry That Overtook — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Idempotent Producers And Retries — Apache Kafka & Event Streaming