LLM Eval

DeepEval

Pytest-style unit testing for LLM outputs, 50+ metrics, Apache 2.0

LangWatch

OpenTelemetry-native LLMOps platform for tracing, evals and agents

Maxim AI

Agent evaluation, simulation and observability in one workflow

Opik

Open-source LLM tracing, evals and guardrails you can self-host

Promptfoo

MIT-licensed LLM eval and red-teaming CLI, now owned by OpenAI