AI engineering glossary · Evaluation metrics

What is ERR (expected reciprocal rank)?

Expected reciprocal rank (also called ERR): A ranking metric built on a cascade user model: the reader scans down the list and stops once satisfied, with the chance of satisfaction growing with an item's relevance grade. The score is the expected reciprocal of the position where the user stops. It rewards a strong result early and discounts redundancy.

Level: advancedTopic: Evaluation metrics

Expected reciprocal rank: an example

If a very relevant page sits at rank 1, most simulated users stop there, so later pages add little to the ERR score.

Related terms

More Evaluation metrics terms

Where you learn it

Expected reciprocal rank is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.