context compaction

Replacing older turns of a long conversation with a model-written summary so the history fits the context again.

In more detail

Compact when the history passes a trigger, keep the newest turns word for word, and write the summariser's prompt for the agent that carries on. Test the summary for the identifiers, numbers and promises later turns depend on; Anthropic and others also offer compaction as an API feature.

Related terms

Taught in

References

Certification courses