Best Alternatives to RouteLLM

Open-source strong/weak model router from UC Berkeley LMSYS. Compare 10 similar free AI tools.

  1. OpenRouter Unified API gateway to 30+ free models (Free: 30+ free models; OpenAI-compatible)
  2. Martian Mechanistic interpretability routing — claims up to 98% cost savings; $9M backed (Free: Free tier available)
  3. LiteLLM Unified OpenAI-format interface for 100+ providers — proxy server (Free: Fully free; proxy server)
  4. Helicone One-line proxy — cost tracking, 95% cache savings, 100+ model providers (Free: Free self-host; 100K free cloud requests)
  5. Ollama Run 100+ LLMs locally from the terminal — completely free (Free: Free; 100+ models locally)
  6. Unify.ai Quality/cost/latency sliders — live benchmarks updated every 10 minutes (Free: $100 free credits)
  7. Arize Phoenix Open-source LLM observability — traces, evaluations, experiments, prompt tracking in a single dashboard (Free: Fully open source; self-hosted)
  8. PricePerToken.com Real-time LLM pricing across all providers — MCP server for Claude Code (Free: 100% free; MCP integration)
  9. DeepSeek API GPT-4 class at $0.27/M tokens (Free: Unlimited (rate-limited); $0.27/M tokens)
  10. PyTorch Dominant DL framework — ~87K stars (Free: BSD-3)

View RouteLLM details

Best Alternatives to RouteLLM

Open-source strong/weak model router from UC Berkeley LMSYS. Here are 10 similar tools you can use — including open-source options.

RouteLLM
LMSYS (UC Berkeley) · Cost Optimization · Fully free; open source
Visit →
#1
OpenRouter59% match

Unified API gateway to 30+ free models

OpenRouterFree: 30+ free models; OpenAI-compatible
Visit →
#2
Martian50% match

Mechanistic interpretability routing — claims up to 98% cost savings; $9M backed

Martian AIFree: Free tier available
Visit →
#3
LiteLLMOPEN SOURCE47% match

Unified OpenAI-format interface for 100+ providers — proxy server

BerriAIFree: Fully free; proxy server
Visit →
#4
HeliconeOPEN SOURCE47% match

One-line proxy — cost tracking, 95% cache savings, 100+ model providers

Helicone, Inc.Free: Free self-host; 100K free cloud requests
Visit →
#5
OllamaOPEN SOURCE45% match

Run 100+ LLMs locally from the terminal — completely free

OllamaFree: Free; 100+ models locally
Visit →
#6
Unify.ai45% match

Quality/cost/latency sliders — live benchmarks updated every 10 minutes

UnifyFree: $100 free credits
Visit →
#7
Arize PhoenixOPEN SOURCE44% match

Open-source LLM observability — traces, evaluations, experiments, prompt tracking in a single dashboard

Arize AIFree: Fully open source; self-hosted
Visit →
#8
PricePerToken.comOPEN SOURCE44% match

Real-time LLM pricing across all providers — MCP server for Claude Code

CommunityFree: 100% free; MCP integration
Visit →
#9
DeepSeek APIOPEN SOURCE43% match

GPT-4 class at $0.27/M tokens

DeepSeekFree: Unlimited (rate-limited); $0.27/M tokens
Visit →
#10
PyTorchOPEN SOURCE42% match

Dominant DL framework — ~87K stars

Meta / PyTorch FoundationFree: BSD-3
Visit →
View RouteLLM details →← Browse all tools