AI engineering glossary · MLOps, LLMOps cloud
What is HPA (Horizontal Pod Autoscaler)?
Horizontal Pod Autoscaler (also called HPA): A Kubernetes controller that changes the number of pod copies up or down based on measured load, such as average CPU use or a custom metric like requests per second. It matches capacity to demand and avoids paying for idle replicas.
Horizontal Pod Autoscaler: an example
With a target of 60% CPU, traffic during an IPL final pushes a service from 3 to 12 pods, then back down afterwards.
Related terms
More MLOps, LLMOps cloud terms
- IAM role
- Identity and access management
- Image scanning
- Image tag
- Immutable infrastructure
- Infrastructure as code
- Ingress
- Integration test
Where you learn it
Horizontal Pod Autoscaler is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.