Artificial Analysis Intelligence Index · Higher is better
Output tokens per second · Higher is better
Weighted average cost (USD) per Intelligence Index task · Lower is better
New article published · 16 Oct
Reflection has released Beam, their first model launch
New language model evaluation · 16 Oct
Beam 1.0Beam 1.0
New article published · 15 Oct
NVIDIA Releases Nemotron 3.5 Super VL and Nemotron 3.5 Bolt 74B A9B
New language model evaluation · 15 Oct
Solar Pro 4Solar Pro 4
New language model evaluation · 15 Oct
Muse Spark Open (Xhigh)Muse Spark Open (Xhigh)
New language model evaluation · 15 Oct
Nemotron 3.5 Super VLNemotron 3.5 Super VL
New language model evaluation · 15 Oct
Nemotron 3.5 Bolt 74B-A9BNemotron 3.5 Bolt 74B-A9B
New article published · 14 Oct
Welcome to the era of embodied AI: Introducing AA-Robotics v0.1
New article published · 13 Oct
Artificial Analysis Decision Index v1.0
New article published · 12 Oct
Muse Wonder and Muse Wonder Full: a material jump in intelligence over previous Meta models
New article published · 12 Oct
Announcing FrontierCode on Artificial Analysis: can AI models write code maintainers would merge?
New article published · 12 Oct
Announcing AA-3D: a benchmark for AI models building interactive 3D experiences
New language model evaluation · 12 Oct
Muse Wonder Full (Max)Muse Wonder Full (Max)
New language model evaluation · 12 Oct
Muse Wonder (Max)Muse Wonder (Max)
New Speech to Text model · 12 Oct
Zoom Scribe V2 ProZoom Scribe V2 Pro
New article published · 8 Oct
Introducing trusted-access models to the Artificial Analysis Cyber Index
New article published · 8 Oct
Announcing Harvey LAB-AA v1.1: adding hallucination checks to raise the bar for agentic legal work
New language model evaluation · 8 Oct
GPT-6 Sol (Daybreak Blue, max)GPT-6 Sol (Daybreak Blue, max)
New article published · 7 Oct
Anthropic has released Claude Haiku 5.5
New language model evaluation · 7 Oct
Claude Haiku 5.5 (High)Claude Haiku 5.5 (High)See more

Intelligence, speed and cost of leading language models, based on our independent evaluations

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
No publicly available API

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Intelligence Index vs. Cost per Task, by Model Release

All reasoning and effort variants of each selected release · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Frontier Language Model Intelligence, Over Time

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1

Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index v1.5 incorporates 3 benchmarks: DeepSWE v1.1, Terminal-Bench 4.0, and SWE-Atlas-QnA · Higher is better

Artificial Analysis Cyber Index

Artificial Analysis Cyber Index v1 incorporates 3 evaluations: CWE-Bench-AA, DeepsecBench-AA, and CyberGym-E2E-AA
Successes
Safety blocks
Trusted-access model (not publicly available)

Artificial Analysis Decision Index

Weighted average of AA-Omniscience-Decision, HLE-MultiChoice, When2Call and WildGuardTest · Higher is better

Capability Index Comparison

Rank among the selected models on each capability index
Capability Index Comparison
Finance & AccountingStrategy & OpsLegalHealthcare & MedicalEngineeringEconomics
Claude Opus 5.5 (Max, Default Fallback)1 (61)1 (64)1 (63)1 (61)1 (60)1 (66)
Claude Fable 5.1 (Max, Default Fallback)3 (56)2 (60)2 (60)3 (58)3 (56)2 (63)
Claude Sonnet 5.5 (Max, Default Fallback)2 (57)3 (60)5 (56)2 (58)2 (58)3 (61)
GPT-6 Astra (Max)4 (55)4 (57)3 (59)4 (52)4 (55)4 (60)
GPT-6.1 Sol (Max)5 (54)5 (57)4 (58)5 (51)5 (54)5 (59)
Grok 4.7 (Xhigh)6 (52)6 (54)6 (54)6 (47)6 (47)6 (56)
Kimi K3 (Max)7 (47)8 (50)8 (49)8 (45)13 (43)7 (53)
Gemini 3.8 Flash (High)8 (47)9 (48)7 (52)12 (42)14 (43)10 (52)
MiMo-V2.6-Pro9 (46)10 (48)11 (45)11 (42)8 (47)8 (53)
GLM-5.3 (Max)13 (45)11 (48)13 (42)7 (47)7 (47)12 (51)
Qwen3.8 Max (0902)10 (46)12 (47)10 (46)13 (41)9 (46)11 (52)
Step 5 Preview11 (45)13 (47)9 (46)14 (41)10 (45)9 (53)
Claude Haiku 5.5 (Max)14 (44)15 (40)12 (42)10 (44)11 (45)13 (51)
GLM-5.3-Flash15 (42)14 (45)15 (40)9 (45)12 (44)14 (49)
DeepSeek V4.1 Flash (Max)12 (45)7 (52)14 (41)15 (41)15 (39)15 (44)

Evaluations

Intelligence evaluations measured independently by Artificial Analysis · Higher is better
See more
No publicly available API

Agentic knowledge work, (Elo-500)/2000

Agentic SaaS workflows

Agentic real-world work tasks, (Elo-500)/2000

Reasoning & knowledge

Professional document reasoning, All-pass

Agentic coding & terminal use

Long context reasoning

SciCodeUnder review

Coding

CritPtUnder review

Physics reasoning

Agentic scientific research workflows in a terminal

Agentic software engineering in open-source repositories

Quantitative analysis on spreadsheets & documents

Legal agentic work, Hallucination-Gated All-Pass Rate

Agentic business operations

Kubernetes incident root-cause analysis

Medical long context reasoning

Visual reasoning

More from Artificial Analysis