AI engineering glossary · Data engineering
What is Apache Beam?
Apache Beam: An open-source programming model for defining batch and streaming pipelines once and running them on different execution engines, such as Flink, Spark or Google Dataflow. It offers unified concepts like windows and triggers.
Apache Beam: an example
A pipeline written with the Beam Python SDK reads events, windows them and writes counts, then runs on a chosen runner.
Related terms
More Data engineering terms
Where you learn it
Apache Beam is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.