mean reciprocal rank
The average, over queries, of 1 divided by the rank of the first relevant result, so 1 means the answer always came first.
In more detail
MRR rewards putting one right answer at the top, which suits questions with a single answer. It ignores everything after the first hit.
Related terms
- recall at k — The share of the relevant passages for a query that appear in the top k results.
- normalised discounted cumulative gain — A ranking score that uses graded relevance, discounts results lower down the list, and divides by the best possible score so 1 is a perfect ranking.
Taught in
- Measuring Retrieval — AI Engineering: LLM Apps, RAG & Agents