AI engineering glossary · Data engineering

What is Apache Airflow?

Apache Airflow (also called Airflow): An open-source platform for authoring, scheduling and monitoring workflows written as Python code. Tasks and their dependencies are declared, and it retries failures and shows run history in a web interface.

Level: beginnerTopic: Data engineering

Apache Airflow: an example

An Airflow workflow runs at 1 a.m.: extract sales, validate, transform, then refresh a dashboard table.

Related terms

More Data engineering terms

Where you learn it

Apache Airflow is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.