eval harness

The code that runs every eval case through the system, applies the checks and reports scores per case and overall.

In more detail

Checks are plain functions that return pass or fail with a reason, such as "cites a source" or "uses the refusal sentence". Prefer them to model grading wherever a rule can decide, because they are fast, free and repeatable.

Related terms

Taught in

References

Certification courses