routing (LLM)

A workflow that classifies each input and sends it to a specialised prompt, tool or model.

In more detail

Routing lets each path be tuned on its own and sends easy requests to cheaper models. Give the router a way out, such as a fallback label or a human, for inputs it cannot classify confidently.

Related terms

Taught in

References

Certification courses