All tasks / Text & knowledge / Embeddings & retrieval
Best local AI for embeddings & retrieval
Open-weights models and tools that run entirely on your own hardware, ranked from public benchmarks. Local tools are rated by the best open model they run.
STop ranked: harrier-oss-v1-27b (Microsoft), 74.3% on MTEB(Multilingual, v2).13 options listed · data verified 19 Oct 2026
Ranked list
| Tier | Name | Approach | Runs | Rated by | Price | Skill | Compare |
|---|---|---|---|---|---|---|---|
| S |  harrier-oss-v1-27bMicrosoft | Models | Local | 74.3% on MTEB(Multilingual, v2) | ~54 GB VRAM | — | |
| S |  KaLM-Embedding-Gemma3-12B-2511Tencent | Models | Local | 72.3% on MTEB(Multilingual, v2) | ~24 GB VRAM | — | vs harrier-oss-v1-27b |
| S |  Qwen3-Embedding-8BAlibaba (Qwen) | Models | Local | 70.6% on MTEB(Multilingual, v2) | ~16 GB VRAM | — | vs harrier-oss-v1-27b |
| S |  OllamaOllama | Vector databases & engines | Local | via Qwen3-Embedding-8B | Free | intermediate | |
| S |  vLLMvLLM project | Vector databases & engines | Local | via Qwen3-Embedding-8B | Free | advanced | |
| S |  Text Embeddings InferenceHugging Face | Vector databases & engines | Local | via Qwen3-Embedding-8B | Free | advanced | |
| A | harrier-oss-v1-0.6b Microsoft | Models | Local | 69% on MTEB(Multilingual, v2) | ~2 GB VRAM | — | vs harrier-oss-v1-27b |
| A |  F2LLM-v2-14BAnt Group (codefuse-ai) | Models | Local | 68.7% on MTEB(Multilingual, v2) | ~28 GB VRAM | — | vs harrier-oss-v1-27b |
| A |  jina-embeddings-v5 (omni-small)Jina AI (Elastic) | Models | Local | 67% on MTEB(Multilingual, v2) | ~4 GB VRAM | — | |
| B |  nomic-embed-text-v2-moeNomic AI | Models | Local | 57.6% on MTEB(Multilingual, v2) | ~2 GB VRAM | — | |
| B |  snowflake-arctic-embed-l-v2.0Snowflake | Models | Local | 57% on MTEB(Multilingual, v2) | ~3 GB VRAM | — | |
| B |  zembed-1ZeroEntropy | Models | Local | 56.6% on MTEB(Multilingual, v2) | ~8 GB VRAM | — | |
| C |  granite-embedding-311m-multilingual-r2IBM | Models | Local | 56% on MTEB(Multilingual, v2) | ~1 GB VRAM | — |
Tiers come only from public benchmarks (MTEB(Multilingual, v2)); tools without a result of their own inherit the tier of the best model they offer. How we rank.