All tasks / Tools
vLLM
Open-source high-throughput inference and serving engine for LLMs, exposing an OpenAI-compatible API.
- vLLM project
- Local only
- Free, open source
Where it ranks
- SChat & assistantsRuntimes & gateways · Local · via Kimi K3
- SEmbeddings & retrievalVector databases & engines · Local · via Qwen3-Embedding-8B
- BCodingRuntimes & gateways · Local · via DeepSeek-V4.1-Flash-1017
- AImage understandingRuntimes & gateways · Local · via Gemma 4 (31B)
Tools without a benchmark of their own inherit the tier of the best model they offer.
Facts
- Vendor
- vLLM project
- Approach
- Runtimes & gateways, Vector databases & engines
- Where it runs
- Runs only on your own hardware
- Interface
- Command line, API
- Skill level
- Advanced: command line, node graphs or self-hosting
- Price
- Free, open source
- Pricing notes
- Free and open source.
- Source code
- Open source (Apache-2.0)
- GitHub stars
- 94.1k (18 Oct 2026)
- Last verified
- 18 Oct 2026
Price from github.com, 18 Oct 2026.
Models it gives you
- SKimi K3Moonshot AI · open weights
- SQwen3-Embedding-8BAlibaba (Qwen) · open weights
- AGLM-5.3Z.ai · open weights
- ADeepSeek-V4.1-Flash-1017DeepSeek · open weights
- ADeepSeek-V4-Pro-0813DeepSeek · open weights
- AGemma 4 (31B)Google DeepMind · open weights
- Ajina-embeddings-v5 (omni-small)Jina AI (Elastic) · open weights
- AMiniMax-M3MiniMax · open weights
- AQwen3.8-27BAlibaba (Qwen) · open weights
- Bnomic-embed-text-v2-moeNomic AI · open weights
- Bgpt-oss-120bOpenAI · open weights
- Bsnowflake-arctic-embed-l-v2.0Snowflake · open weights
- BQwen3.8-2.4T-A95BAlibaba (Qwen) · open weights
- CLlama 4 MaverickMeta · open weights
- Cgpt-oss-20bOpenAI · open weights
- CQwen3-Coder-NextAlibaba (Qwen) · open weights
- –bge-m3BAAI · open weights
- –bge-reranker-v2-m3BAAI · open weights
- –EmbeddingGemma 2Google · open weights
- –Qwen3-Reranker-8BAlibaba (Qwen) · open weights