outbox relay
The process that reads unpublished rows from an outbox table, publishes them to a message broker such as Kafka and then marks them as published.
In more detail
Running it again is safe because published rows are filtered out. It can poll the table on a schedule, or be replaced by a change data capture connector that reads the database log.
Related terms
- transactional outbox — Saving an event into an outbox table in the same database transaction as the business change, then having a separate worker publish it.
- change data capture — Reading every insert, update and delete from a database's own change log and turning them into a stream of events.
- Debezium — An open-source change data capture platform that reads database change logs and publishes each change as an event to Kafka.
Taught in
- The Transactional Outbox — Apache Kafka & Event Streaming
- Idempotency, And Exactly Once As A Fiction — Scalable System Design & Distributed Architecture