Apache Flink
An open-source engine for stateful processing of data streams at large scale, often reading from and writing to Kafka.
In more detail
Unlike Kafka Streams it runs as its own cluster. It saves consistent snapshots of its state, called checkpoints, to recover after failures.
Related terms
- Kafka Streams — A Java library, part of Apache Kafka, for building applications that read, transform and write Kafka streams.
- checkpointing — Periodically saving a consistent snapshot of a program's state and input positions so it can resume from there after a failure.
- state store — Local storage where a stream processing application keeps the current results of its computations.
Taught in
- Materialised Views From A Stream — Apache Kafka & Event Streaming