AI engineering glossary · Data engineering
What is lambda architecture?
Lambda architecture: A design that runs a batch layer for accurate, complete results over all history and a speed layer for quick results on recent data, then merges both when queried. It gives low latency and accuracy but means maintaining two code paths.
Lambda architecture: an example
Yesterday's totals come from a nightly batch job, and today's running totals come from a stream, and dashboards combine them.
Related terms
More Data engineering terms
- Late-arriving data
- Lazy evaluation
- MapReduce
- Master data management
- Medallion architecture
- Message broker
- Message queue
- Object storage
Where you learn it
Lambda architecture is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.