AI engineering glossary · MLOps, LLMOps cloud

What is workflow orchestration?

Workflow orchestration: Software that schedules and runs multi-step jobs in the right order, handling dependencies, retries, failures and alerts. It is the control layer that runs data and ML pipelines reliably. Airflow, Prefect and Dagster are common examples.

Level: intermediateTopic: MLOps, LLMOps cloud

Workflow orchestration: an example

An orchestrator runs extract, then feature building, then training, and retries the training step twice if a GPU node fails.

Related terms

More MLOps, LLMOps cloud terms

Where you learn it

Workflow orchestration is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.