recall at k
The share of the relevant passages for a query that appear in the top k results.
In more detail
For RAG it asks whether the answer reaches the prompt at all: if it is not in the top k chunks, the model cannot use it. Approximate indexes and compression are judged by recall at k against exact search.
Related terms
- mean reciprocal rank — The average, over queries, of 1 divided by the rank of the first relevant result, so 1 means the answer always came first.
- normalised discounted cumulative gain — A ranking score that uses graded relevance, discounts results lower down the list, and divides by the best possible score so 1 is a perfect ranking.
- labelled query set — A set of real questions, each with the passages judged relevant, often on a graded scale, used to score retrieval.
- context recall — An eval metric for RAG retrieval: the share of the facts a reference answer needs that appear in the retrieved context.
Taught in
- From Prompts To Context — AI Engineering: LLM Apps, RAG & Agents
- Memory And Compaction — AI Engineering: LLM Apps, RAG & Agents
- Embedding Models — AI Engineering: LLM Apps, RAG & Agents
- Vector Indexes And Databases — AI Engineering: LLM Apps, RAG & Agents
- Measuring Retrieval — AI Engineering: LLM Apps, RAG & Agents
- How RAG Works And When To Use It — AI Engineering: LLM Apps, RAG & Agents
- Retrieval That Finds The Right Thing — AI Engineering: LLM Apps, RAG & Agents
- Evaluating RAG And Agents — AI Engineering: LLM Apps, RAG & Agents
- Capstone: The Tasks Assistant — AI Engineering: LLM Apps, RAG & Agents