All tasks / Tools
KoboldCpp
Single-file local runner for GGUF models built on llama.cpp, with a web UI for story writing, chat and roleplay plus an API.
- LostRuins (open-source project)
- Local only
- Free, open source
Where it ranks
- AWritingApps + Runtimes & gateways · Local · via Kimi K3
Tools without a benchmark of their own inherit the tier of the best model they offer.
Facts
- Vendor
- LostRuins (open-source project)
- Approach
- Apps, Runtimes & gateways
- Where it runs
- Runs only on your own hardware
- Interface
- Desktop app, Self-hosted web UI, API
- Skill level
- Intermediate: some setup or configuration
- Price
- Free, open source
- Pricing notes
- Free and open source (AGPL-3.0). uses_models = the general (non-coding) open families from the llama.cpp record, since KoboldCpp is built on llama.cpp and runs the same GGUF files.
- Source code
- Open source (AGPL-3.0)
- GitHub stars
- 12k (18 Oct 2026)
- Last verified
- 18 Oct 2026
Price from github.com, 18 Oct 2026.
Models it gives you
- AKimi K3Moonshot AI · open weights
- AGLM-5.3Z.ai · open weights
- ADeepSeek-V4-Pro-0813DeepSeek · open weights
- ADeepSeek-V4.1-Flash-1017DeepSeek · open weights
- BGemma 4 (31B)Google DeepMind · open weights
- BMiniMax-M3MiniMax · open weights
- BQwen3.8-27BAlibaba (Qwen) · open weights
- CLlama 4 MaverickMeta · open weights
- Cgpt-oss-120bOpenAI · open weights
- Cgpt-oss-20bOpenAI · open weights
- CQwen3.8-2.4T-A95BAlibaba (Qwen) · open weights