AI engineering glossary · MLOps, LLMOps cloud
What is prometheus?
Prometheus: An open-source monitoring system that regularly pulls numeric metrics from services, stores them as time series and supports a query language, PromQL, and alert rules. It is a standard choice for Kubernetes monitoring.
Prometheus: an example
Prometheus scrapes a model server's `/metrics` page every 15 seconds and alerts if p95 latency exceeds 500 ms.
Related terms
More MLOps, LLMOps cloud terms
- ReplicaSet
- Resource requests and limits
- Role-based access control
- Rolling update
- Scale to zero
- Secrets management
- Security group
- Serverless
Where you learn it
Prometheus is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.