AI engineering glossary · MLOps, LLMOps cloud
What is kubernetes pod?
Kubernetes pod (also called Pod): The smallest deployable unit in Kubernetes: one or more tightly coupled containers that share a network address and storage and are always scheduled together on the same node. Pods are temporary, so they are normally created and replaced by higher-level controllers.
Kubernetes pod: an example
A pod holds a model-server container plus a small logging sidecar container that share the same network address.
Related terms
More MLOps, LLMOps cloud terms
- Kubernetes Secret
- Kubernetes service
- Liveness and readiness probes
- LLM cost management
- LLM evaluation pipeline
- LLM gateway
- LLM observability
- LLMOps
Where you learn it
Kubernetes pod is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.