context rot

The fall in a model's accuracy as its input grows longer, even on simple tasks and well within the context window.

In more detail

Chroma's 2025 study measured it across many models, and found that distracting but similar passages make it worse. Keep contexts short and relevant rather than filling the window because it is there.

Related terms

Taught in

References

Certification courses