AI engineering glossary · MLOps, LLMOps cloud
What is fallback model?
Fallback model: A secondary model or provider automatically used when the primary one fails, times out or is rate-limited. It improves availability of language-model applications, though answer style and quality may differ from the primary.
Fallback model: an example
When the main provider returns errors, the gateway retries the request on a backup model so users still get a reply.
Related terms
More MLOps, LLMOps cloud terms
Where you learn it
Fallback model is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.