HolyGrAIL

All tasks / Tools

llama-swap

Open-source proxy that hot-swaps between local model servers (llama.cpp, vLLM and others) behind one OpenAI-compatible endpoint.

  • mostlygeek
  • Local only
  • Free, open source

Official site · Source code

Where it ranks

  • A
    Chat & assistants
    Runtimes & gateways · Local · via GLM-5.3-Flash
  • C
    Coding
    Runtimes & gateways · Local · via GLM-5.3-Flash

Tools without a benchmark of their own inherit the tier of the best model they offer.

Facts

Vendor
mostlygeek
Approach
Runtimes & gateways
Where it runs
Runs only on your own hardware
Interface
API
Skill level
Advanced: command line, node graphs or self-hosting
Price
Free, open source
Pricing notes
Free and open source.
Source code
Open source (MIT)
GitHub stars
6k (19 Oct 2026)
Last verified
19 Oct 2026

Price from github.com, 19 Oct 2026.

Models it gives you

Sources