AI engineering glossary · MLOps, LLMOps cloud
What is GPU instance?
GPU instance: A cloud virtual machine that includes one or more graphics processing units, used for training and running deep-learning models. They are expensive and often scarce, so teams watch utilisation and shut them down when idle.
GPU instance: an example
An instance with 8 GPUs is rented for a training run and billed per hour until it is stopped.
Related terms
- Amazon EC2
- GPU utilisation
- Spot instance
- Compute budget
More MLOps, LLMOps cloud terms
- Grafana
- Health check
- High availability
- Horizontal Pod Autoscaler
- IAM role
- Identity and access management
- Image scanning
- Image tag
Where you learn it
GPU instance is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.