AI engineering glossary · Data engineering

What is checkpointing?

Checkpointing: Periodically saving the state and progress of a long-running or streaming job to durable storage, so after a failure it can resume from the last saved point rather than start over.

Level: advancedTopic: Data engineering

Checkpointing: an example

A Flink job saves its state every minute; after a crash it restarts from the most recent checkpoint.

Related terms

More Data engineering terms

Where you learn it

Checkpointing is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.