AI engineering glossary · Evals guardrails AI security
What is answer relevancy?
Answer relevancy (also called response relevance): A metric for how directly a generated answer addresses the user's question, penalising off-topic, redundant or missing content. An answer can be perfectly faithful to its sources yet still fail to answer what was asked, so relevancy is measured separately.
Answer relevancy: an example
Asked 'What is the notice period?', an answer that describes the whole leave policy without giving the notice period scores low.
Related terms
More Evals guardrails AI security terms
- Attack success rate
- Attack surface
- Automated red teaming
- Backdoor attack
- Benchmark saturation
- Canary token
- Chatbot Arena
- Citation checking
Where you learn it
Answer relevancy is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.