evaluator-optimiser

A pattern in which one model call produces an answer and another critiques it against criteria, looping until it passes or a limit is reached.

In more detail

It helps when good output is easy to recognise but hard to produce first time, as in Self-Refine. Cap the rounds, and prefer a check in code when one exists.

Related terms

Taught in

References

Certification courses