AI engineering glossary · MLOps, LLMOps cloud
What is serverless?
Serverless: A cloud model where the provider runs and scales the servers, and you supply only code or a container, paying per use. It removes server management and can scale to zero, but has limits on run time, memory and start-up delay.
Serverless: an example
A function that resizes uploaded images runs only when a file arrives and is billed by the millisecond.
Related terms
- AWS Lambda
- Cold start
- Scale to zero
- Function as a service
More MLOps, LLMOps cloud terms
- Service level indicator
- Sidecar container
- Smoke test
- Staging environment
- Stateless service
- Terraform
- Token usage tracking
- Virtual private cloud
Where you learn it
Serverless is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.