trajectory eval

Grading the path an agent took, its sequence of tool calls, in addition to the outcome it reached.

In more detail

Decide success from the final state of the system, never from what the agent says it did. Keep path checks to what matters, such as a required lookup and a budget, so a valid but different route is not punished while overreach still shows.

Related terms

Taught in

References

Certification courses