Speech Agent Arena 排行榜 | Artificial Analysis

Speech Agent Arena 排行榜New Arena 概览与示例New

Speech Agent Arena 排行榜Artificial Analysis

通过实时语音对话的盲测偏好比较 Speech to Speech 模型，对话主题包括预约牙医和订购外卖。更多详情请参阅概览和方法论，或访问比较模型和提供商，在其他基准测试中比较 Speech to Speech 模型。

	Range	Creator	Model	Elo	Elo 95% CI	Samples	Task Success Rate	TSR 95% CI
1	1-2	Google	Gemini 3.1 Flash Live Minimal	1096	-27/27	841	74.6%	69.4%/79.2%
2	1-4	Google	Gemini 3.8 Live	1083	-30/30	482	93.2%	89.0%/95.8%
3	2-5	Google	Gemini 3.1 Flash Live High	1063	-27/27	813	71.8%	66.4%/76.7%
4	3-6	OpenAI	GPT-Live-1 (Sol, low)	1053	-28/28	652	90.9%	87.2%/93.7%
5	3-6	OpenAI	GPT-Live-1 (Astra, medium)	1048	-28/28	610	87.4%	82.9%/90.8%
6	3-9	Cartesia	Cartesia Line (Default Cascaded System)	1027	-37/37	190	77.5%	68.9%/84.3%
7	6-10	SpaceXAI	Grok Voice Think Fast 2.0 High	1011	-28/28	552	94.6%	91.4%/96.7%
8	8	OpenAI	GPT-Realtime-1.5	1000	0/0	811	85.1%	80.8%/88.6%
9	7-12	ElevenLabs	ElevenLabs Agents (Default Cascaded System)	993	-26/26	773	90.5%	86.7%/93.4%
10	7-12	Google	Gemini 3.8 Live Extended Thinking (High)	990	-27/27	643	89.1%	84.7%/92.4%
11	8-12	OpenAI	GPT Realtime (Aug '25)	974	-26/26	797	89.4%	85.2%/92.6%
12	9-12	Amazon Bedrock	Nova 2.0 Sonic (Mar 2026)	974	-26/26	795	57.1%	51.1%/62.9%
13	13-19	OpenAI	GPT-Realtime-2.1 Minimal	937	-26/26	798	89.4%	85.2%/92.5%
14	13-20	OpenAI	GPT-Realtime-2 (High)	932	-26/26	764	89.8%	85.7%/92.9%
15	13-20	OpenAI	GPT-Realtime-2.1 High	928	-26/26	749	91.5%	87.7%/94.3%
16	13-20	OpenAI	GPT Realtime Mini (Oct '25)	917	-26/26	830	79.6%	74.6%/83.8%
17	13-20	OpenAI	GPT-Realtime-2 (Minimal)	916	-26/26	830	84.7%	80.3%/88.3%
18	13-20	Deepgram	Deepgram Voice Agent (Default Cascaded System)	914	-26/26	817	73.7%	68.5%/78.2%
19	13-20	Amazon	Nova Sonic	913	-26/26	827	57.1%	51.6%/62.5%
20	14-20	SpaceXAI	Grok Voice Think Fast 1.0	908	-26/26	864	80.7%	75.8%/84.8%
21	21-24	Inworld	Inworld Realtime (Default Cascaded System)	867	-26/26	811	69.9%	64.3%/75.0%
22	21-25	Alibaba Cloud	Qwen3.5 Omni Plus Realtime	859	-26/26	821	62.0%	56.4%/67.2%
23	21-25	Alibaba Cloud	Qwen Audio 3.0 Realtime Flash	850	-40/40	166	81.7%	70.1%/89.4%
24	21-25	Alibaba Cloud	Qwen3.5 Omni Flash Realtime	841	-26/26	847	29.1%	24.0%/34.8%
25	22-25	OpenAI	GPT-Realtime-2.1 Mini Minimal	840	-27/27	821	76.7%	71.1%/81.4%
26	26	Alibaba Cloud	Qwen Audio 3.0 Realtime Plus	775	-44/44	171	77.8%	66.9%/85.8%

A Default Cascaded System is a provider’s standard voice-agent pipeline: its orchestration harness connects a speech-to-text model, an LLM, and a text-to-speech model. These entries use the provider’s default stack, rather than a custom pipeline optimized by Artificial Analysis.

Tool registration indicates whether tool definitions are pre-registered or supplied during session setup. As of July 2026:

Model	Harness	STT	LLM	TTS	Tool registration
Deepgram Voice Agent	Deepgram Voice Agent API	Nova-3	GPT-4o Mini	Aura-2	Session-level
ElevenLabs Agents	ElevenLabs Agents	Scribe v2 Realtime	Gemini 2.5 Flash	Eleven Flash v2	Pre-registered
Cartesia Line	Cartesia Line	Ink	Gemini 2.5 Flash	Sonic	Pre-registered schemas; Arena execution
Inworld Realtime	Inworld Realtime API	Inworld STT 1	Gemini 2.5 Flash	Inworld TTS 1.5 Mini	Session-level