model fallback

Sending a request to a second model or provider when the first keeps failing, so the user still gets an answer.

In more detail

A fallback model needs the same evaluation as the main one, because its answers may differ in quality, format and cost. Decide in advance which errors trigger it and log when it is used.

Related terms

Taught in

References

Certification courses