AI engineering glossary · Evals guardrails AI security
What is pyRIT?
PyRIT: Python Risk Identification Tool, an open-source framework from Microsoft for automating red-team testing of generative AI systems. It orchestrates attack prompts, targets and scorers so security teams can probe models and applications for risks repeatedly.
PyRIT: an example
A security engineer scripts a multi-turn attack against a chatbot endpoint and has a scorer flag which replies violate policy.
Related terms
More Evals guardrails AI security terms
- Red teaming
- Reference-based evaluation
- Reference-free evaluation
- Refusal rate
- Role-play jailbreak
- Rubric-based grading
- Safety evaluation
- Sandboxing
Where you learn it
PyRIT is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.