All tasks / Tools

LMDeploy

Open-source toolkit for compressing, deploying and serving LLMs and VLMs with an OpenAI-compatible server.

  • InternLM (Shanghai AI Laboratory)
  • Local only
  • Free, open source

Official site · Source code

Where it ranks

Tools without a benchmark of their own inherit the tier of the best model they offer.

Facts

Vendor
InternLM (Shanghai AI Laboratory)
Approach
Runtimes & gateways
Where it runs
Runs only on your own hardware
Interface
API, Command line
Skill level
Advanced: command line, node graphs or self-hosting
Price
Free, open source
Pricing notes
Free and open source.
Source code
Open source (Apache-2.0)
GitHub stars
8.1k (19 Oct 2026)
Last verified
19 Oct 2026

Price from github.com, 19 Oct 2026.

Models it gives you

Sources