AI engineering glossary · MLOps, LLMOps cloud
What is SLI (service level indicator)?
Service level indicator (also called SLI): A specific measurement of how well a service is performing from the user's point of view, such as the fraction of requests answered successfully or the share answered within 300 ms. It is the raw number that objectives are set against.
Service level indicator: an example
The indicator is the proportion of prediction requests that return within 200 ms; this month it is 99.3%.
Related terms
More MLOps, LLMOps cloud terms
- Sidecar container
- Smoke test
- Staging environment
- Stateless service
- Terraform
- Token usage tracking
- Virtual private cloud
- Workflow orchestration
Where you learn it
Service level indicator is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.