retrieval-augmented generation

Answering a question by first retrieving relevant passages from your own documents and adding them to the prompt, so the model answers from them.

In more detail

Lewis and colleagues named the approach in 2020. It has three stages, built and tested apart: ingestion splits, embeds and stores documents ahead of time; retrieval finds the best chunks per question; generation answers only from them, with citations. It suits large, changing or permissioned knowledge that will not fit or should not sit in every prompt.

Related terms

Taught in

References

Certification courses