Patronus AI
patronus.ai · LLM Evals
Automated evaluation platform with research backed judge models for catching hallucinations and unsafe outputs.
Patronus AI is one of 20 LLM eval tools on TrueIQ. See all LLM eval tools or how we check facts.
See site
// guides
Guides that cover Patronus AI
LLM Hallucination Detection: Methods and Tools
How LLM hallucination detection works in 2026: faithfulness checks, detector models like HHEM, self consistency and semantic entropy, and the tools to use.
LLM Red Teaming Tools: Promptfoo, garak, PyRIT
The best LLM red teaming tools in 2026 compared: Promptfoo, garak, PyRIT, DeepTeam and Giskard, with licenses, first commands and OWASP LLM Top 10 coverage.
// related
Patronus AI alternatives and related tools
DeepEvaldeepeval.comPytest style framework for unit testing LLM apps with metrics for hallucination, relevance, RAG quality and more.LLM EvalsOpen source★ 19.2k
Inspect AIinspect.aisi.org.ukMIT licensed framework from the UK AI Security Institute for rigorous LLM and agent evaluations, with tool use, sandboxed tasks and 200+ prebuilt evals.LLM EvalsOpen source★ 3.1k
Promptfoopromptfoo.devOpen source CLI for testing prompts, models and RAG apps with assertions, side by side comparisons and automated red teaming. Part of OpenAI since 2026 and still MIT licensed.LLM EvalsOpen source★ 26.5k
garakgarak.aiNVIDIA's open source (Apache 2.0) LLM vulnerability scanner that probes models and endpoints for jailbreaks, prompt injection, data leakage and toxic output.LLM EvalsOpen source★ 9.7k
OpenCompassopencompass.org.cnComprehensive evaluation platform from Shanghai AI Lab supporting many models, datasets and a public leaderboard.LLM EvalsOpen source★ 7.6k
Giskardgiskard.aiOpen source Python library for evaluating and red teaming AI agents and RAG apps. Version 3 is a modular rewrite for multiturn testing; v2 is no longer maintained.LLM EvalsOpen source★ 5.9k