chunk (retrieval)

A passage cut from a document for indexing, and the unit that retrieval returns and the prompt includes.

In more detail

Split along the document's own headings, keep tables and lists whole, pack blocks up to a token budget and overlap neighbours a little. Each chunk should make sense alone, which is why many pipelines prepend the heading path or a short context.

Related terms

Taught in

References

Certification courses