duplicate record

A second copy of a record that was meant to be written or processed only once.

In more detail

Duplicates come from producer retries after a lost acknowledgement, from consumers that crash before committing, and from deliberate replays. Kafka's default at-least-once delivery accepts them, so consumers must deduplicate or be idempotent.

Related terms

Taught in

References

Certification courses