RouteLLM

An open-source model router from UC Berkeley's LMSYS team that intelligently decides whether to send a query to a strong (expensive) or weak (cheap) model. Fully self-hosted with no vendor lock-in.

AI ToolFree Tier: Fully free; open sourceCompany: LMSYS (UC Berkeley)Category: Cost OptimizationOpen Source: YesQuick Start: Install with pip install routellm → Configure your strong and weak model endpoints → Use the router to automatically classify and route queries by difficulty

RouteLLM

Open-source strong/weak model router from UC Berkeley LMSYS

Visit RouteLLM →

An open-source model router from UC Berkeley's LMSYS team that intelligently decides whether to send a query to a strong (expensive) or weak (cheap) model. Fully self-hosted with no vendor lock-in.

FREE TIER
Fully free; open source
COMPANY
LMSYS (UC Berkeley)
CATEGORY
Cost Optimization › Model Routing
OPEN SOURCE
Yes
PRIVACY
Self-hosted
TAGS
routingopen-source

QUICK START

Install with pip install routellm → Configure your strong and weak model endpoints → Use the router to automatically classify and route queries by difficulty

BEST FOR

  • ▸Teams optimizing LLM API costs by intelligently routing queries to strong/weak models.
  • ▸Developers needing full control, self-hosting, and no vendor lock-in for LLM routing.
  • ▸Organizations prioritizing privacy with an open-source, self-hosted LLM router.

NOT FOR

  • ✕Non-technical users seeking a simple, managed SaaS solution for LLM routing.
  • ✕Users without the technical expertise or resources for self-hosting infrastructure.
Finding similar tools…
← Back to all tools