HolyGrAIL

All tasks / Tools

Xinference

Open-source platform to deploy and serve LLMs, embedding and multimodal models on your own hardware behind an OpenAI-compatible API.

  • Xorbits
  • Local only
  • Free, open source

Official site · Source code

Where it ranks

  • S
    Chat & assistants
    Runtimes & gateways · Local · via Kimi K3
  • B
    Coding
    Runtimes & gateways · Local · via DeepSeek-V4.1-Flash-1017

Tools without a benchmark of their own inherit the tier of the best model they offer.

Facts

Vendor
Xorbits
Approach
Runtimes & gateways
Where it runs
Runs only on your own hardware
Interface
API, Self-hosted web UI, Command line
Skill level
Advanced: command line, node graphs or self-hosting
Price
Free, open source
Pricing notes
Free and open source.
Source code
Open source (Apache-2.0)
GitHub stars
9.6k (19 Oct 2026)
Last verified
19 Oct 2026

Price from github.com, 19 Oct 2026.

Models it gives you

Sources