checkpointing
Periodically saving a consistent snapshot of a program's state and input positions so it can resume from there after a failure.
In more detail
Stream processors such as Flink use checkpoints to recover without reprocessing the whole stream. Checkpoints are taken regularly, so only the work since the last one is repeated after a crash.
Related terms
- Apache Flink — An open-source engine for stateful processing of data streams at large scale, often reading from and writing to Kafka.
- state store — Local storage where a stream processing application keeps the current results of its computations.
Taught in
- Ninety Minutes, No Question Count — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- The Data Centre That Went Dark — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Full Disks On Black Friday — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Materialised Views From A Stream — Apache Kafka & Event Streaming