Claude Haiku 5.5 vs. Gemini 3.8 Flash：发布比较

Claude Haiku 5.5 与 Gemini 3.8 Flash 发布比较：分别包含 5 个和 3 个模型，各自具有不同的智能、性能与价格特征。下方对全部 8 个模型的关键指标进行了比较。

智能方面，Claude Haiku 5.5 得分最高：Claude Haiku 5.5 (Max)（43），Gemini 3.8 Flash 为 Gemini 3.8 Flash (High)（41）。
输出速度方面，Claude Haiku 5.5 最快：Claude Haiku 5.5 (Max)（240 token/秒），Gemini 3.8 Flash 为 Gemini 3.8 Flash (High)（133 token/秒）。
单任务成本方面，Claude Haiku 5.5 最低：Claude Haiku 5.5 (Low)（$0.02），Gemini 3.8 Flash 为 Gemini 3.8 Flash (Medium)（$2.59）。

比较的发布


	Claude Haiku 5.5 (max)	Claude Haiku 5.5 (xhigh)	Gemini 3.8 Flash (high)	Gemini 3.8 Flash (medium)	Claude Haiku 5.5 (high)	Claude Haiku 5.5 (medium)	Gemini 3.8 Flash (low)	Claude Haiku 5.5 (low)
Intelligence Index	43	41	41	40	38	34	33	29
财务与会计	44	41	47	45	38	35	39	29
战略与运营	40	39	48	48	37	34	39	28
法律	42	40	52	51	38	36	45	31
医疗与健康	40	35	40	40	34	32	34	27
工程	45	43	43	40	39	35	34	31
经济学	51	49	52	50	46	43	46	37
AA-Briefcase v1.1	1575	1524	1202	1182	1440	1369	1062	1114
GDPval-AA v2.1	1628	1521	1445	1432	1425	1283	1317	1131
AutomationBench-AA	35.4%	36.0%	59.9%	60.9%	33.7%	28.6%	36.5%	22.9%
Terminal-Bench 4.0	32.8%	29.3%	19.7%	19.7%	21.7%	15.2%	10.1%	12.6%
SciCode	55.0%	51.7%	56.6%	55.1%	48.7%	49.0%	55.0%	49.2%
Humanity's Last Exam	44.4%	42.7%	47.8%	42.1%	37.3%	33.8%	37.1%	27.0%
GDP.pdf	20.8%	18.2%	21.0%	22.8%	17.2%	15.2%	18.6%	11.2%
CritPt	18.9%	22.6%	18.3%	12.3%	18.6%	12.9%	4.0%	9.1%
AA-Omniscience	11	6	30	29	6	4	21	3
AA-LCR v1.1	82.7%	78.3%	81.3%	84.0%	77.3%	77.3%	80.7%	72.0%

每任务成本美元	$0.21	$0.12	$3.49	$2.59	$0.08	$0.05	--	$0.02
输入价格美元/100 万 Token	$0.10	$0.10	$0.75	$0.75	$0.10	$0.10	$0.75	$0.10
输出价格美元/100 万 Token	$0.50	$0.50	$3.75	$3.75	$0.50	$0.50	$3.75	$0.50
缓存命中价格美元/100 万 Token	$0.01	$0.01	$0.075	$0.075	$0.01	$0.01	$0.075	$0.01
缓存写入价格美元/100 万 Token	$0.125	$0.125	$0.75	$0.75	$0.125	$0.125	$0.75	$0.125

输出速度Token/秒	240	195	133	--	185	174	--	181
首 Token 延迟秒	332.02	69.39	25.27	--	25.05	11.39	--	8.04
首个回答 Token 时间秒	332.02	69.39	25.27	--	25.05	11.39	--	8.04
端到端响应时间秒	334.10	71.95	29.04	--	27.75	14.26	--	10.81
每任务耗时秒	425.91	289.00	519.86	--	189.58	119.37	--	60.85

上下文窗口	1M	1M	1M	1M	1M	1M	1M	1M
开发商	Anthropic	Anthropic	Google	Google	Anthropic	Anthropic	Google	Anthropic
许可证	专有	专有	专有	专有	专有	专有	专有	专有
输入模态	支持：文本和图像	支持：文本和图像	支持：文本、图像、语音和视频	支持：文本、图像、语音和视频	支持：文本和图像	支持：文本和图像	支持：文本、图像、语音和视频	支持：文本和图像
输出模态	支持：文本	支持：文本	支持：文本	支持：文本	支持：文本	支持：文本	支持：文本	支持：文本
服务商

智能

Artificial Analysis Intelligence Index · Higher is better

速度

Output tokens per second · Higher is better

每任务成本

Weighted average cost (USD) per Intelligence Index task · Lower is better

智能

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, and AA-LCR v1.1

Artificial Analysis Intelligence Index v4.3.2 includes: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Intelligence Index 与每项任务的成本

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task

Most attractive quadrant

Claude Haiku 5.5

Gemini 3.8 Flash

Pareto line

AA-Briefcase v1.1

GDPval-AA v2.1

单任务成本（美元，对数刻度）

Weighted average cost per Intelligence Index task. Each evaluation’s cost is calculated from input, cache hit, cache write, reasoning, and answer token prices, divided by task count, and weighted by its Intelligence Index weight.

成本

每项 Intelligence Index 任务的成本

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

速度与延迟

输出速度

Output tokens per second · Higher is better

Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Figures represent performance of the model's first-party API or the median across providers where a first-party API is not available.

能力得分

能力指数

衡量模型在特定能力与行业中的表现

Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

基准测试

AA-PersonalityBenchNew

模型 Avs模型 B

AA-PersonalityBench：Expressiveness 指数，Claude Haiku 5.5 (max) vs Gemini 3.8 Flash (high)

根据两者的 Elo 差距，每个模型的回答在各特质上被判定为更显著的概率 · 50% 表示势均力敌

Claude Haiku 5.5 (max)

Gemini 3.8 Flash (high)

Metaphorical

94%

Natural Sounding

93%

Eloquent

20%

80%

Literate

74%

26%

Lexically Varied

74%

26%

Claude Haiku 5.5 vs. Gemini 3.8 Flash：发布比较

智能

速度

每任务成本

智能

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index

Intelligence Index 与每项任务的成本

Cost per Intelligence Index Task

Artificial Analysis Intelligence Index

成本

每项 Intelligence Index 任务的成本

Cost per Intelligence Index Task

速度与延迟

输出速度

Output Speed

Model Performance Representation

能力得分

能力指数

基准测试

AA-PersonalityBenchNew

AA-PersonalityBench：Expressiveness 指数，Claude Haiku 5.5 (max) vs Gemini 3.8 Flash (high)