contextual retrieval

Anthropic's technique of having a model write a short note placing each chunk in its document, and prepending it before embedding and keyword indexing.

In more detail

Anthropic reported that contextual embeddings and contextual BM25 together cut retrieval failures substantially, and more with reranking. The notes cost a model call per chunk at ingestion, which prompt caching makes affordable.

Related terms

Taught in

References

Certification courses