HolyGrAIL

All tasks / Tools

TensorRT LLM

NVIDIA's open-source library for optimised LLM inference and serving on NVIDIA GPUs.

  • NVIDIA
  • Local only
  • Free, open source

Official site · Source code

Where it ranks

  • S
    Chat & assistants
    Runtimes & gateways · Local · via Kimi K3
  • B
    Coding
    Runtimes & gateways · Local · via DeepSeek-V4.1-Flash-1017

Tools without a benchmark of their own inherit the tier of the best model they offer.

Facts

Vendor
NVIDIA
Approach
Runtimes & gateways
Where it runs
Runs only on your own hardware
Interface
API, Command line
Skill level
Advanced: command line, node graphs or self-hosting
Price
Free, open source
Pricing notes
Free and open source.
Source code
Open source
GitHub stars
14.9k (19 Oct 2026)
Last verified
19 Oct 2026

Price from github.com, 19 Oct 2026.

Models it gives you

Sources