AI engineering glossary · MLOps, LLMOps cloud
What is kubernetes service?
Kubernetes service (also called Service): A stable network name and address that sends traffic to a changing set of pods chosen by labels. Since pods come and go with new addresses, a service gives other applications one fixed endpoint and spreads requests across healthy pods.
Kubernetes service: an example
Other apps call `http://fraud-api` and the service distributes each request among the four running fraud-api pods.
Related terms
- Kubernetes pod
- Ingress
- Load balancer
- Service discovery
More MLOps, LLMOps cloud terms
- Liveness and readiness probes
- LLM cost management
- LLM evaluation pipeline
- LLM gateway
- LLM observability
- LLMOps
- Logging
- Managed service
Where you learn it
Kubernetes service is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.