AI engineering glossary · MLOps, LLMOps cloud
What is health check?
Health check: A lightweight request or command that reports whether a service is alive and able to do its job. Load balancers, orchestrators and monitors use it to stop sending traffic to unhealthy instances and to trigger restarts.
Health check: an example
A `/health` endpoint returns 200 OK when the model is loaded and 503 when it is not.
Related terms
More MLOps, LLMOps cloud terms
- High availability
- Horizontal Pod Autoscaler
- IAM role
- Identity and access management
- Image scanning
- Image tag
- Immutable infrastructure
- Infrastructure as code
Where you learn it
Health check is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.