Voice agents
Real-time speech-to-speech models, the voice modes of the big assistants, platforms for building phone and web voice agents, and open frameworks to run your own.
Models are ranked by Artificial Analysis Speech Agent Arena (models), Artificial Analysis Speech to Speech Index, then Artificial Analysis Big Bench Audio (speech reasoning) for models without a result on the first. Tools with their own result on Artificial Analysis Speech Agent Arena (cascaded agent platforms) or Cekura Bench: voice agent platforms (workflow benchmark v1) are ranked by it (each board ranks one kind of product); other tools inherit the tier of the best model they offer. How we rank.
- Best overallSGemini 3.8 Live1,088 on Artificial Analysis Speech Agent Arena (models)
- Best valueSGemini 3.8 LiveTier S for $0.01/min of audio
- Best free startSCartesia LineFree tier · from $5/mo · 1,034 on Artificial Analysis Speech Agent Arena (cascaded agent platforms)
- Best local (≤24 GB GPU)No qualifying option yet
- Tier: how close to the best result on the task's main public benchmark
- Outlined: a tool inherits the tier of the best model it offers
- No public result yet
- Cloud · Local: runs on your own hardware
Models
The engines themselves. Use them through an API or inside the apps on the right.
Apps
Ready-made apps with a UI: sign in or install, then start.
Nothing tracked yet
Voice-agent platforms
Build, test and deploy voice agents for phone lines and websites, with little code.
Frameworks
Open frameworks that wire speech recognition, a model and a voice into your own real-time agent.
Nothing tracked yet
Quality vs. price
Artificial Analysis Speech Agent Arena (models) score against API price (USD per minute of audio, log scale). Up and to the left is better; the line joins the models that nothing else beats on both.
- Closed models
- Open-weights models
- Best-value frontier
Show as table
| Model | Weights | Artificial Analysis Speech Agent Arena (models) | Price | Frontier |
|---|---|---|---|---|
| Gemini 3.8 Live | Closed | 1,088 | $0.01/min of audio | Yes |
| Grok Voice 3.0 | Closed | 1,070 | $0.08/min of audio | |
| GPT-Live 1 | Closed | 1,057 | $0.05/min of audio | |
| GPT-Realtime-2.1 | Closed | 941 | $0.19/min of audio | |
| GPT-Realtime-2.1 Mini | Closed | 844 | $0.08/min of audio | |
| Qwen Audio 3.0 Realtime Plus | Closed | 792 | $0.07/min of audio |
Quality vs. setup
The same tools as the map, placed by how good the results can be (up) and how much setup they take (right). Top-left is the easiest way to top quality; further right buys control, privacy or price at the cost of setup. Models are left out: you reach them through these tools.
- Cloud
- Local: runs on your hardware
- Hollow: tier inherited from the best model the tool offers
Not placed (no public result yet): Pipecat, LiveKit Agents, speech-to-speech (Hugging Face), TEN Framework, Unmute, Bolna, Bland, Claude, Meta AI, Microsoft Copilot, Millis AI, PolyAI, Sesame, Synthflow, Telnyx Voice AI Agents, Thoughtly, Ultravox, Vapi, Voiceflow
Everything, in order
| Tier | Name | Approach | Runs | Rated by | Price | Skill |
|---|---|---|---|---|---|---|
| S | Cartesia | Voice-agent platforms | Cloud | 1,034 on Artificial Analysis Speech Agent Arena (cascaded agent platforms) | Free tier · $5/mo | intermediate |
| S | Google | Models | Cloud | 1,088 on Artificial Analysis Speech Agent Arena (models) | $0.01/min of audio | — |
| S | xAI | Models | Cloud | 1,070 on Artificial Analysis Speech Agent Arena (models) | $0.08/min of audio | — |
| S | ElevenLabs | Voice-agent platforms | Cloud | 998 on Artificial Analysis Speech Agent Arena (cascaded agent platforms) | Free tier · $6/mo | beginner |
| S | Google | Apps | Cloud | via Gemini 3.8 Live | Free tier · $4.99/mo | beginner |
| S | SpaceXSI (formerly xAI) | Apps | Cloud | via Grok Voice 3.0 | Free tier · $8/mo | beginner |
| A | OpenAI | Models | Cloud | 1,057 on Artificial Analysis Speech Agent Arena (models) | $0.05/min of audio | — |
| A | OpenAI | Apps | Cloud | via GPT-Live 1 | Free tier · $20/mo | beginner |
| B | Deepgram | Voice-agent platforms | Cloud | 916 on Artificial Analysis Speech Agent Arena (cascaded agent platforms) | Free tier | intermediate |
| B | OpenAI | Models | Cloud | 941 on Artificial Analysis Speech Agent Arena (models) | $0.19/min of audio | — |
| B | Retell AI | Voice-agent platforms | Cloud | via GPT-Realtime-2.1 | Free tier | intermediate |
| C | Alibaba (Qwen) | Models | Cloud | 861 on Artificial Analysis Speech Agent Arena (models) | — | — |
| C | OpenAI | Models | Cloud | 844 on Artificial Analysis Speech Agent Arena (models) | $0.08/min of audio | — |
| C | Alibaba (Qwen) | Models | Cloud | 792 on Artificial Analysis Speech Agent Arena (models) | $0.07/min of audio | — |
| – | Daily (open source) | Frameworks | Local | No public result yet Cloud models: tier B | Free | advanced |
| – | LiveKit | Frameworks | Local | No public result yet Cloud models: tier A | Free | advanced |
| – | Hugging Face | Frameworks | Local | No public result yet | Free | advanced |
| – | TEN (Agora) | Frameworks | Local | No public result yet | Free | advanced |
| – | Kyutai | Frameworks | Local | No public result yet | Free | advanced |
| – | Bolna AI | Voice-agent platforms | Local | No public result yet | Free tier | intermediate |
| – | Bland AI | Voice-agent platforms | Cloud | No public result yet | Free tier | intermediate |
| – | Anthropic | Apps | Cloud | No public result yet | Free tier · $20/mo | beginner |
| – | Boson AI | Models | Cloud | No public result yet | — | — |
| – | Liquid AI | Models | Local | No public result yet | ~4 GB VRAM | — |
| – | Meta | Apps | Cloud | No public result yet | Free tier | beginner |
| – | Microsoft Copilot Microsoft | Apps | Cloud | No public result yet | Free tier · $9.99/mo | beginner |
| – | Millis AI | Voice-agent platforms | Cloud | No public result yet | — | intermediate |
| – | OpenBMB | Models | Local | No public result yet | ~21 GB VRAM | — |
| – | Kyutai | Models | Local | No public result yet | ~24 GB VRAM | — |
| – | Amazon | Models | Cloud | No public result yet | — | — |
| – | NVIDIA | Models | Local | No public result yet | ~25 GB VRAM | — |
| – | Deepslate | Models | Cloud | No public result yet | $0.11/min of audio | — |
| – | NVIDIA | Models | Local | No public result yet | ~24 GB VRAM | — |
| – | PolyAI | Voice-agent platforms | Cloud | No public result yet | — | intermediate |
| – | Alibaba (Qwen) | Models | Local | No public result yet | ~80 GB VRAM | — |
| – | KRAFTON | Models | Local | No public result yet | ~22 GB VRAM | — |
| – | Sesame AI | Apps | Cloud | No public result yet | — | beginner |
| – | StepFun | Models | Local | No public result yet | ~74 GB VRAM | — |
| – | StepFun | Models | Cloud | No public result yet | — | — |
| – | Synthflow AI | Voice-agent platforms | Cloud | No public result yet | — | beginner |
| – | Telnyx | Voice-agent platforms | Cloud | No public result yet | — | intermediate |
| – | Thoughtly | Voice-agent platforms | Cloud | No public result yet | — | beginner |
| – | Ultravox (Fixie) | Voice-agent platforms | Cloud | No public result yet | Free tier | intermediate |
| – | Vapi | Voice-agent platforms | Cloud | No public result yet | Free tier | intermediate |
| – | Voiceflow | Voice-agent platforms | Cloud | No public result yet | — | intermediate |
Benchmarks used
- Artificial Analysis Speech Agent Arena (models) by Artificial Analysis (blind human votes, Elo from blind pairwise votes on live voice-agent conversations (overall slice; GPT-Realtime-1.5 anchored at 1000)) · snapshot 18 Oct 202623 speech-to-speech model entries read from the speech-to-speech page's embedded arena results; the 4 vendor cascaded systems on the same board are in aa-speech-agent-arena-tools. No last-updated date shown.
- Artificial Analysis Speech to Speech Index by Artificial Analysis (automated tests, AA-Speech to Speech Index: weighted average of speech reasoning (Big Bench Audio), agentic performance (tau-Voice), arena preference and task success rate) · snapshot 18 Oct 202619 models with all index components, read from the page's embedded arena results (field stsQualityIndexV2Score, which the index chart plots). Mixes automated tests with the arena's human votes. No last-updated date shown.
- Artificial Analysis Big Bench Audio (speech reasoning) by Artificial Analysis (automated tests, Accuracy on Big Bench Audio: spoken reasoning questions answered in audio (speech in, speech out)) · snapshot 18 Oct 202641 model/provider entries with a score (the page states 41 models evaluated), including open full-duplex models (Moshi, PersonaPlex, Freeze-Omni). Measures reasoning, not voice quality or latency. No last-updated date shown.
- Artificial Analysis Speech Agent Arena (cascaded agent platforms) by Artificial Analysis (blind human votes, Elo from blind pairwise votes on live voice-agent conversations; entries are vendor default cascaded systems (STT + LLM + TTS platforms), ranks tools) · snapshot 18 Oct 2026Same board and Elo scale as aa-speech-agent-arena; only the platform entries: Cartesia Line (Default Cascaded System) 1033.6, ElevenLabs Agents (Default Cascaded System) 998.0, Deepgram Voice Agent (Default Cascaded System) 915.5, Inworld Realtime (Default Cascaded System) 876.2.
- Cekura Bench: voice agent platforms (workflow benchmark v1) by Cekura (automated tests, Reliability pass^3: share of 82 phone-call scenarios (appointment workflow with tools) a platform passes on all three runs, judged by Cekura's evaluator suite, ranks tools) · snapshot 12 Oct 2026Page 'Last updated Oct 12, 2026'; 'frozen v1 release', 8 configurations x 82 scenarios x 3 runs (246 retained calls each). Same table also ranks two speech-to-speech models (GPT Realtime 64.6, Gemini Live 30.5), recorded under cekura-voice-agents. Platforms chose their own LLM/STT/TTS configuration (published in github.com/cekura-ai/cekura-bench/provider-configurations), so results mix platform and model choices. Platform rows: Retell 75.6, LiveKit 70.7, ElevenLabs 69.5, Telnyx 68.3, Pipecat 63.4, Vapi 59.8; all tracked. Cekura sells voice-agent testing and observability, not voice agents; it integrates with the platforms it ranks.