AI engineering glossary · Evaluation metrics
What is ROUGE?
ROUGE (also called Recall-Oriented Understudy for Gisting Evaluation, ROUGE-N): A family of metrics for automatic summarisation that measure how much of the reference summary's word sequences also appear in the generated summary. ROUGE-N counts overlapping n-grams and is recall-oriented, though precision and F-scores are also reported.
ROUGE: an example
Reference: 'the cat sat on the mat' (6 words); summary: 'the cat on the mat'. Five of the six reference unigrams are matched, so ROUGE-1 recall = 5/6, about 0.83.
Related terms
More Evaluation metrics terms
- ROUGE-L
- Slice-based evaluation
- Spearman's rank correlation
- Specificity
- Symmetric mean absolute percentage error
- Temperature scaling
- Token-level F1
- Translation edit rate
Where you learn it
ROUGE is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.