AI engineering glossary · Data engineering
What is kappa architecture?
Kappa architecture: A simplification where all processing, live and historical, is done by a single stream-processing path over an immutable log, with reprocessing done by replaying the log. It avoids duplicating logic across batch and speed layers.
Kappa architecture: an example
To fix a bug, the team replays the Kafka log from the start through the corrected stream job.
Related terms
More Data engineering terms
- Lambda architecture
- Late-arriving data
- Lazy evaluation
- MapReduce
- Master data management
- Medallion architecture
- Message broker
- Message queue
Where you learn it
Kappa architecture is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.