labelled query set

A set of real questions, each with the passages judged relevant, often on a graded scale, used to score retrieval.

In more detail

Build it by pooling the top results of several systems and having people grade them. It turns opinions about retrieval into numbers; keep it growing, and distrust small differences while it is small.

Related terms

Taught in

References

Certification courses