AI engineering glossary · MLOps, LLMOps cloud
What is kubernetes node?
Kubernetes node: A single machine, physical or virtual, in a cluster that runs pods. Each node runs an agent that talks to the control plane, plus a container runtime. Nodes can have special hardware such as GPUs, which pods request when needed.
Kubernetes node: an example
A cluster has ten CPU nodes for web services and two GPU nodes reserved for model inference.
Related terms
More MLOps, LLMOps cloud terms
- Kubernetes pod
- Kubernetes Secret
- Kubernetes service
- Liveness and readiness probes
- LLM cost management
- LLM evaluation pipeline
- LLM gateway
- LLM observability
Where you learn it
Kubernetes node is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.