All tasks / Tools

LiteLLM

Open-source Python SDK and proxy gateway that calls 100+ LLM APIs and local servers through one OpenAI-format interface.

  • BerriAI
  • Local or cloud
  • Free, open source

Official site · Source code

Where it ranks

  • S
    Chat & assistants
    Runtimes & gateways · Local · via Kimi K3
    With cloud models: tier S (via Gemini 4 Argon)
  • B
    Coding
    Runtimes & gateways · Local · via DeepSeek-V4.1-Flash-1017
    With cloud models: tier S (via Claude Opus 5.5)

Tools without a benchmark of their own inherit the tier of the best model they offer.

Facts

Vendor
BerriAI
Approach
Runtimes & gateways
Where it runs
Runs fully on your hardware with local models; cloud models optional
Interface
API, Self-hosted web UI
Skill level
Advanced: command line, node graphs or self-hosting
Price
Free, open source
Pricing notes
Open-source core free to self-host; enterprise features licensed separately.
Source code
Open source
GitHub stars
61.5k (19 Oct 2026)
Last verified
19 Oct 2026

Price from github.com, 19 Oct 2026.

Models it gives you

Compare

Alternatives to LiteLLM

Sources