AI engineering glossary · Evals guardrails AI security
What is promptfoo?
promptfoo: An open-source tool for testing prompts and models with test cases and assertions, comparing outputs side by side and running red-team scans. It fits into continuous integration so prompt changes are checked automatically before release, catching regressions early.
promptfoo: an example
A developer writes 40 test cases in a config file and runs promptfoo in CI to block a prompt change that drops pass rate below 90 percent.
Related terms
More Evals guardrails AI security terms
- PyRIT
- Red teaming
- Reference-based evaluation
- Reference-free evaluation
- Refusal rate
- Role-play jailbreak
- Rubric-based grading
- Safety evaluation
Where you learn it
promptfoo is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.