DeepEval

deepeval.com · LLM Evals

Open source

#1 in LLM Evals

Pytest style framework for unit testing LLM apps with metrics for hallucination, relevance, RAG quality and more.

#pytest#metrics#rag#llm-as-judge

DeepEval is one of 20 LLM eval tools on TrueIQ. See all LLM eval tools or how we check facts.

// guides

Guides that cover DeepEval

What Is Answer Completeness in RAG Evaluation?
What is answer completeness in RAG evaluation? The share of key facts from a reference answer that a response covers, and how Azure, Bedrock and Ragas score it.
Inspect AI vs DeepEval: Which Should You Use?
Inspect AI vs DeepEval in 2026: how the two open source eval frameworks differ on who runs the model, scoring, agents, sandboxes, CI and which team each one suits.
What Is Faithfulness in RAG Evaluation?
What is faithfulness in RAG evaluation? The share of an answer's claims backed by the retrieved context, and how Ragas, DeepEval, TruLens and HHEM score it.
How to Evaluate LLM Model Performance
How to evaluate LLM model performance before you pick one: build a task test set, fix settings, add error bars, test prompt sensitivity, then weigh cost.
OpenAI Evals vs DeepEval: Which to Use?
OpenAI Evals vs DeepEval in 2026: platform shutdown timeline, DeepEval's pytest CI metrics, multiprovider support, and Promptfoo as the migration path.
RAG Evaluation Metrics: Ragas vs DeepEval vs TruLens
RAG evaluation metrics explained: faithfulness, relevancy, context precision and recall, which need a reference, and how Ragas, DeepEval and TruLens differ.

// related