LiteLLM

A unified OpenAI-format proxy server that lets you call 100+ LLM providers through a single API. Essential infrastructure for multi-model setups — switch providers or add fallbacks without changing application code.

AI ToolFree Tier: Fully free; proxy serverCompany: BerriAICategory: Cost OptimizationOpen Source: YesQuick Start: Install with pip install litellm → Start the proxy server with litellm --model your-model → Point your application to the LiteLLM endpoint instead of the provider directly

LiteLLM

Unified OpenAI-format interface for 100+ providers — proxy server

Visit LiteLLM →

A unified OpenAI-format proxy server that lets you call 100+ LLM providers through a single API. Essential infrastructure for multi-model setups — switch providers or add fallbacks without changing application code.

FREE TIER
Fully free; proxy server
COMPANY
BerriAI
CATEGORY
Cost Optimization › Observability
OPEN SOURCE
Yes
PRIVACY
Self-hosted routing
TAGS
proxyunified-api

QUICK START

Install with pip install litellm → Start the proxy server with litellm --model your-model → Point your application to the LiteLLM endpoint instead of the provider directly

BEST FOR

  • ▸Developers building multi-LLM apps needing flexible provider switching & fallbacks.
  • ▸Teams prioritizing data privacy with self-hosted LLM routing infrastructure.
  • ▸Engineers optimizing costs by dynamically routing requests across diverse LLM APIs.

NOT FOR

  • ✕Users with simple, single-model projects; adds unnecessary infrastructure complexity.
  • ✕Individuals preferring fully managed LLM services over self-hosted proxies.

◈ TYPICALLY PAIRED WITH

Tools that appear alongside LiteLLM in AIArsenal's curated stacks.

Google Gemini API
Most generous free tier — all models including 2.5 Pro/Flash, 1M context
Developer Tools
Agno
529× faster agents than LangGraph, 50× lower memory
Developer Tools
Mem0
Persistent AI memory — 26% better accuracy, 91% lower latency
Developer Tools
AWS SageMaker Studio Lab
Free T4 GPU, 4hrs/session, 15GB storage — no AWS account needed
Infrastructure
Finding similar tools…
← Back to all tools