model router
A service that sends each request to one of many models or providers behind a single API, often with automatic fallbacks.
In more detail
OpenRouter is a common example: it exposes hundreds of models through one OpenAI-compatible API and can be told which providers to prefer, which to avoid and whether they may keep your data. Routers simplify switching, but add a third party to your data path.
Related terms
- model fallback — Sending a request to a second model or provider when the first keeps failing, so the user still gets an answer.
- OpenAI-compatible API — An API that accepts the same request and reply shapes as OpenAI's, so existing client code and libraries work against another model server.
Taught in
- Choosing A Model — AI Engineering: LLM Apps, RAG & Agents
- The Request And The Response — AI Engineering: LLM Apps, RAG & Agents