AI engineering glossary · Evals guardrails AI security
What is Guardrails AI?
Guardrails AI: An open-source Python framework that wraps language model calls with validators, checking that outputs meet rules such as valid JSON, no personal data or no toxic language, and retrying or fixing them when they do not.
Guardrails AI: an example
A developer attaches a validator that requires a reply to be valid JSON with a 'refund_amount' field and re-asks the model when it is not.
Related terms
More Evals guardrails AI security terms
- HarmBench
- HELM
- HumanEval
- Improper output handling
- Input guardrail
- Intrinsic hallucination
- ISO/IEC 42001
- Jailbreak
Where you learn it
Guardrails AI is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.