Debezium
An open-source change data capture platform that reads database change logs and publishes each change as an event to Kafka.
In more detail
Its PostgreSQL connector reads a replication slot and writes one topic per table, with each event holding the row before and after the change and the operation type. It usually runs inside Kafka Connect.
Related terms
- change data capture — Reading every insert, update and delete from a database's own change log and turning them into a stream of events.
- Kafka Connect — The Kafka framework for running connectors that copy data between Kafka and other systems without writing custom code.
- replication slot — A PostgreSQL object that remembers how far a consumer of the change stream has read, so no changes are lost between reads.
Taught in
- The Connector That Was Created Twice — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Change Data Capture In Principle — Apache Kafka & Event Streaming