60+ benchmarks — powers the Open LLM Leaderboard. Compare 10 similar free AI tools.
View lm-eval-harness details
60+ benchmarks — powers the Open LLM Leaderboard. Here are 10 similar tools you can use — including open-source options.
Primary open LLM evaluation leaderboard
30+ metrics + red teaming 40+ vulnerabilities
Open-source LLM observability — traces, evaluations, experiments, prompt tracking in a single dashboard
70+ fairness metrics + 10 mitigation algorithms
Best all-around open LLM — 8B to 405B
Quality/cost/latency sliders — live benchmarks updated every 10 minutes
Zero-code fine-tuning Web UI — 40K+ stars
LLM orchestration — 700+ integrations
2–5× faster, 80% less VRAM fine-tuning
Framework-agnostic LLM tracing — generous free tier, European privacy