AI engineering glossary · MLOps, LLMOps cloud
What is liveness and readiness probes?
Liveness and readiness probes: Health checks Kubernetes runs against a container. A liveness probe decides whether to restart a container that is stuck; a readiness probe decides whether it should receive traffic yet. Readiness is vital for model servers that take minutes to load weights.
Liveness and readiness probes: an example
A GPU pod fails its readiness probe until its 20 GB model finishes loading, so no user requests reach it prematurely.
Related terms
More MLOps, LLMOps cloud terms
- LLM cost management
- LLM evaluation pipeline
- LLM gateway
- LLM observability
- LLMOps
- Logging
- Managed service
- Metrics
Where you learn it
Liveness and readiness probes is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.