AI engineering glossary · MLOps, LLMOps cloud

What is metrics?

Metrics: Numeric measurements collected over time, such as requests per second, error percentage, memory use and GPU utilisation. They are cheap to store and aggregate, and form the basis of dashboards and alerts.

Level: beginnerTopic: MLOps, LLMOps cloud

Metrics: an example

A time series records 120 requests per second at 10:00 and 340 at 10:05.

Related terms

More MLOps, LLMOps cloud terms

Where you learn it

Metrics is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.