HolyGrAIL

All tasks / Tools

MLC LLM

Open-source compiler and engine that deploys LLMs natively on GPUs, phones and browsers, with an OpenAI-compatible server.

  • MLC AI
  • Local only
  • Free, open source

Official site · Source code

Where it ranks

  • A
    Chat & assistants
    Runtimes & gateways · Local · via Gemma 4 (31B)
  • C
    Coding
    Runtimes & gateways · Local · via Qwen3.8-27B

Tools without a benchmark of their own inherit the tier of the best model they offer.

Facts

Vendor
MLC AI
Approach
Runtimes & gateways
Where it runs
Runs only on your own hardware
Interface
Command line, API, Mobile app
Skill level
Advanced: command line, node graphs or self-hosting
Price
Free, open source
Pricing notes
Free and open source.
Source code
Open source (Apache-2.0)
GitHub stars
23.3k (19 Oct 2026)
Last verified
19 Oct 2026

Price from github.com, 19 Oct 2026.

Models it gives you

Sources