AI engineering glossary · MLOps, LLMOps cloud

What is LLMOps?

LLMOps: MLOps adapted to applications built on large language models. Alongside deployment and monitoring it manages prompts, retrieval data, evaluation sets, cost per request, safety filters and provider changes, since these often matter more than training a model from scratch.

Level: intermediateTopic: MLOps, LLMOps cloud

LLMOps: an example

An LLMOps setup versions every prompt, runs an evaluation suite before release and tracks token spend per feature.

Related terms

More MLOps, LLMOps cloud terms

Where you learn it

LLMOps is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.