AI engineering glossary · MLOps, LLMOps cloud
What is kubernetes?
Kubernetes (also called K8s): An open-source system that runs and manages many containers across a group of machines. You declare what you want, such as five copies of a service, and it schedules them, restarts failed ones, balances traffic and rolls out updates. It is the standard platform for production workloads.
Kubernetes: an example
A company tells Kubernetes to run five replicas of its recommendation API; when one machine fails, Kubernetes starts replacements elsewhere automatically.
Related terms
More MLOps, LLMOps cloud terms
- Kubernetes cluster
- Kubernetes deployment
- Kubernetes node
- Kubernetes pod
- Kubernetes Secret
- Kubernetes service
- Liveness and readiness probes
- LLM cost management
Where you learn it
Kubernetes is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.