HolyGrAIL

All tasks / Tools

mistral.rs

Open-source Rust inference engine for LLMs and multimodal models with quantisation and an OpenAI-compatible server.

  • Eric Buehler
  • Local only
  • Free, open source

Official site · Source code

Where it ranks

  • A
    Chat & assistants
    Runtimes & gateways · Local · via GLM-5.3-Flash
  • C
    Coding
    Runtimes & gateways · Local · via GLM-5.3-Flash

Tools without a benchmark of their own inherit the tier of the best model they offer.

Facts

Vendor
Eric Buehler
Approach
Runtimes & gateways
Where it runs
Runs only on your own hardware
Interface
Command line, API
Skill level
Advanced: command line, node graphs or self-hosting
Price
Free, open source
Pricing notes
Free and open source.
Source code
Open source (MIT)
GitHub stars
7.8k (19 Oct 2026)
Last verified
19 Oct 2026

Price from github.com, 19 Oct 2026.

Models it gives you

Sources