Ragas

An open-source library of evaluation metrics for RAG pipelines and agents, such as faithfulness, context precision, context recall and tool call accuracy.

In more detail

Many of its metrics use a model as judge, so validate them against your own labels like any judge. Its scores are most useful for comparing versions of the same pipeline.

Related terms

Taught in

References

Certification courses