LiteLLM

Open source · MITFree open-source core; paid enterprise features

LiteLLM

by BerriAI

One gateway that talks to 100+ model APIs in the same format, with cost tracking and fallbacks.

60.2k stars on GitHub, Oct 2026

Why it's useful

Write your app once and swap between OpenAI, Anthropic, local Ollama and the rest by changing a name. Tracks spend per key so a runaway script doesn't surprise you.

What it needs

Your own keys for whichever model providers you use. Install a current release: versions 1.82.7 and 1.82.8 on PyPI were hijacked with malware in March 2026

The details

Price
Free open-source core; paid enterprise features
Licence
Open source (MIT)
Runs on
Command line, Windows, macOS, Linux, Cloud
Made by
BerriAI
Category
CodingAgents & MCPModels
Tags
llm gatewayproxyapicost trackingpython

Image: Viber Cove. LiteLLM belongs to BerriAI; we just think it's worth knowing about.

More tools like this