lost in the middle

The finding that models use information at the start or end of a long context better than information in the middle.

In more detail

Liu and colleagues reported it in 2023; newer models and tests show it in some settings and not others. Put the most important material where it is used best, usually long documents first and the question last, and measure your own case.

Related terms

Taught in

References

Certification courses