AI engineering glossary · MLOps, LLMOps cloud
What is canary deployment?
Canary deployment (also called Canary release): Releasing a new version to a small share of real traffic first, watching its errors, latency and quality, and widening the share only if it looks healthy. It limits the number of users affected by a faulty release.
Canary deployment: an example
A new LLM prompt version serves 5% of chats for a day; when its thumbs-down rate matches the old one, it goes to 100%.
Related terms
More MLOps, LLMOps cloud terms
- Champion-challenger
- CI pipeline
- CI/CD
- Cloud region
- ConfigMap
- Configuration drift
- Container layer
- Container runtime
Where you learn it
Canary deployment is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.