Alternatives to Ollama

Chat & assistants: runtimes & gateways

S Ollama · Local · via Kimi K3

Alternatives to Ollama for chat & assistants

Tier	Name	Approach	Runs	Rated by	Price	Skill
S	Gemini Enterprise Agent Platform (formerly Vertex AI) Google Cloud	Runtimes & gateways	Cloud	via Gemini 4 Argon	—	advanced
S	OpenRouter OpenRouter	Runtimes & gateways	Cloud	via Gemini 4 Argon	Free tier	intermediate
S	Requesty Requesty	Runtimes & gateways	Cloud	via Gemini 4 Argon	—	intermediate
S	Vercel AI Gateway Vercel	Runtimes & gateways	Cloud	via Gemini 4 Argon	Free tier	intermediate
S	Amazon Bedrock Amazon Web Services	Runtimes & gateways	Cloud	via Claude Opus 5.5	—	advanced
S	DeepInfra DeepInfra	Runtimes & gateways	Cloud	via Claude Opus 5.5	—	intermediate
S	Microsoft Foundry Microsoft	Runtimes & gateways	Cloud	via Claude Fable 5.1	—	advanced
S	llama.cpp ggml-org	Runtimes & gateways	Local	via Kimi K3	Free	advanced

Every chat & assistants option on the full map

Writing: runtimes & gateways

A Ollama · Local · via Kimi K3

Alternatives to Ollama for writing

Tier	Name	Approach	Runs	Rated by	Price	Skill
S	OpenRouter OpenRouter	Runtimes & gateways	Cloud	via Claude Opus 5.5	Free tier	intermediate
A	llama.cpp ggml-org	Runtimes & gateways	Local	via Kimi K3	Free	advanced

Every writing option on the full map

Embeddings & retrieval: vector databases & engines

S Ollama · Local · via Qwen3-Embedding-8B

Alternatives to Ollama for embeddings & retrieval

Tier	Name	Approach	Runs	Rated by	Price	Skill
S	vLLM vLLM project	Vector databases & engines	Local	via Qwen3-Embedding-8B	Free	advanced
S	Text Embeddings Inference Hugging Face	Vector databases & engines	Local	via Qwen3-Embedding-8B	Free	advanced
S	OpenRouter OpenRouter	Vector databases & engines	Cloud	via Qwen3-Embedding-8B	Free tier	intermediate
A	Jina Search Foundation APIs Jina AI (Elastic)	Vector databases & engines	Cloud	via jina-embeddings-v5 (omni-small)	Free tier	intermediate

Every embeddings & retrieval option on the full map

Coding: runtimes & gateways

B Ollama · Local · via DeepSeek-V4.1-Flash-1017

Alternatives to Ollama for coding

Tier	Name	Approach	Runs	Rated by	Price	Skill
S	Amazon Bedrock Amazon Web Services	Runtimes & gateways	Cloud	via Claude Opus 5.5	—	advanced
S	DeepInfra DeepInfra	Runtimes & gateways	Cloud	via Claude Opus 5.5	—	intermediate
S	Gemini Enterprise Agent Platform (formerly Vertex AI) Google Cloud	Runtimes & gateways	Cloud	via Claude Opus 5.5	—	advanced
S	OpenRouter OpenRouter	Runtimes & gateways	Cloud	via Claude Opus 5.5	Free tier	intermediate
S	Requesty Requesty	Runtimes & gateways	Cloud	via Claude Opus 5.5	—	intermediate
S	Vercel AI Gateway Vercel	Runtimes & gateways	Cloud	via Claude Opus 5.5	Free tier	intermediate
S	Microsoft Foundry Microsoft	Runtimes & gateways	Cloud	via GPT-6 Astra	—	advanced
B	Novita AI Novita AI	Runtimes & gateways	Cloud	via Qwen3.8-Max	—	intermediate

Every coding option on the full map

Image understanding: runtimes & gateways

S Ollama · Local · via GLM-5.3-Flash

Alternatives to Ollama for image understanding

Tier	Name	Approach	Runs	Rated by	Price	Skill
S	OpenRouter OpenRouter	Runtimes & gateways	Cloud	via Qwen3.8-Max	Free tier	intermediate
A	llama.cpp ggml-org	Runtimes & gateways	Local	via Gemma 4 (31B)	Free	advanced
A	vLLM vLLM project	Runtimes & gateways	Local	via Gemma 4 (31B)	Free	advanced
A	LocalAI Ettore Di Giacinto (mudler)	Runtimes & gateways	Local	via Gemma 4 (31B)	Free	advanced
A	SGLang SGLang project (LMSYS)	Runtimes & gateways	Local	via Gemma 4 (31B)	Free	advanced
A	LMDeploy InternLM (Shanghai AI Laboratory)	Runtimes & gateways	Local	via Gemma 4 (31B)	Free	advanced
A	MLX-VLM Blaizzy (open-source project)	Runtimes & gateways	Local	via Gemma 4 (31B)	Free	advanced

Every image understanding option on the full map

Tiers come only from public benchmarks; tools without a result of their own inherit the tier of the best model they offer. How we rank.