context (LLM)

Everything a model reads on one call: system prompt, tool definitions, conversation history, retrieved passages and the current request.

In more detail

The model knows nothing about your application beyond its training and this context. It is rebuilt and resent on every call, so what goes in, in what order, decides quality, cost and latency.

Related terms

Taught in

References

Certification courses