Independent analysis of AI

Understand the AI landscape to choose the best model and provider for your use case

Artificial Analysis Intelligence Index · Higher is better
No publicly available API
Output tokens per second · Higher is better
No publicly available API
Weighted average cost (USD) per Intelligence Index task · Lower is better
No publicly available API
New article published · 28 Oct
Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5
New article published · 28 Oct
GitHub Copilot Fusion orchestrates Anthropic and OpenAI models to balance performance and cost
New language model evaluation · 28 Oct
Gemini 4 Carbon (High)Gemini 4 Carbon (High)
New article published · 27 Oct
Announcing Artificial Analysis Intelligence Index v5
Methodology updated · 27 Oct
Artificial AnalysisArtificial Analysis Intelligence Index v5.0
New article published · 26 Oct
GPT-6.1 Terra pushes the cost efficiency frontier
New article published · 26 Oct
Code2Video-AA: how well do AI models design videos in code?
New language model evaluation · 26 Oct
GPT-6.1 Terra (Non-reasoning)GPT-6.1 Terra (Non-reasoning)
New language model evaluation · 26 Oct
GPT-6.1 Terra (Low)GPT-6.1 Terra (Low)
New language model evaluation · 26 Oct
GPT-6.1 Terra (Medium)GPT-6.1 Terra (Medium)
New language model evaluation · 26 Oct
GPT-6.1 Terra (High)GPT-6.1 Terra (High)
New language model evaluation · 26 Oct
GPT-6.1 Terra (Xhigh)GPT-6.1 Terra (Xhigh)
New language model evaluation · 26 Oct
GPT-6.1 Terra (Max)GPT-6.1 Terra (Max)
New article published · 23 Oct
Kimi K3.1 Pro launches at 4th on the Intelligence Index and will lead open weights models
New language model evaluation · 23 Oct
Kimi K3.1 ProKimi K3.1 Pro
New language model evaluation · 23 Oct
Nemotron 3.5 Bolt E4B 4GB (Reasoning)Nemotron 3.5 Bolt E4B 4GB (Reasoning)
New language model evaluation · 22 Oct
Ling 3.1 Flash 1019Ling 3.1 Flash 1019
New article published · 19 Oct
HealthBench and HealthBench Professional: Evaluating models in realistic health conversations
New language model evaluation · 19 Oct
MiniMax-M3.1-FlashMiniMax-M3.1-Flash
New language model evaluation · 18 Oct
DeepSeek V4.1 Flash 1017 (Max)DeepSeek V4.1 Flash 1017 (Max)See more

Intelligence, speed, and cost of leading language models, based on our independent evaluations

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1
No publicly available API

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No publicly available API

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Intelligence Index vs. Cost per Task, by Model Release

All reasoning and effort variants of each selected release · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Artificial Analysis Progress Index v1, Over TimeNew

Item response theory estimate of general capability across Artificial Analysis evaluations · Highest-scoring effort variant shown

Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index v2.0 incorporates 3 benchmarks: FrontierCode v1.1, Terminal-Bench 4.0, and SWE-Atlas-QnA-AA · Higher is better
Color by
Not publicly available

Artificial Analysis Cyber Index

Artificial Analysis Cyber Index v1 incorporates 3 evaluations: CWE-Bench-AA, DeepsecBench-AA, and CyberGym-E2E-AA
Successes
Safety blocks
Trusted-access model (not publicly available)

Artificial Analysis Decision Index

Weighted average of AA-Omniscience-Decision, HLE-MultiChoice, When2Call, and WildGuardTest · Higher is better

Capability Index Comparison

Rank among the selected models on each capability index
Capability Index Comparison
Finance & AccountingStrategy & OpsLegalHealthcare & MedicalEngineeringEconomics
Claude Opus 5.5 (Max, Default Fallback)1 (59)1 (61)1 (58)1 (58)1 (65)1 (62)
GPT-6 Astra (Max)2 (57)3 (58)2 (56)3 (54)2 (62)3 (58)
GPT-6.1 Sol (Max)3 (56)7 (58)4 (54)4 (52)3 (59)4 (57)
Claude Sonnet 5.5 (Max, Default Fallback)4 (56)2 (58)5 (52)2 (54)4 (58)5 (56)
Claude Fable 5.1 (Max, Default Fallback)6 (54)4 (58)3 (54)7 (51)5 (57)2 (59)
Muse Wonder Full (Max)5 (55)5 (58)6 (51)5 (52)6 (55)6 (56)
Kimi K3.1 Pro7 (53)6 (58)7 (49)6 (52)8 (50)7 (51)
Muse Wonder (Max)9 (51)9 (54)9 (47)8 (49)9 (49)8 (51)
GPT-6.1 Terra (Max)10 (49)10 (50)10 (46)10 (45)7 (54)9 (49)
Grok 4.7 (Xhigh)8 (52)8 (55)8 (47)9 (47)11 (41)10 (48)
Qwen3.8 Max (0902)11 (45)13 (47)12 (41)12 (41)12 (39)12 (44)
DeepSeek V4.1 Flash 1017 (Max)14 (42)11 (49)14 (38)11 (41)15 (37)14 (40)
Gemini 3.8 Flash (High)13 (42)14 (47)11 (42)14 (38)13 (38)13 (41)
Claude Haiku 5.5 (Max)12 (44)15 (39)13 (39)15 (37)10 (42)11 (44)
GLM-5.3 (Max)15 (42)12 (47)15 (36)13 (39)14 (38)15 (39)

Evaluations

Evaluations measured independently by Artificial Analysis · AA-PersonalityBench scores are percentile ranks from 1 to 100
See more
No publicly available API

Agentic knowledge work, Elo

1 - hallucination rate

Agentic SaaS workflows

Agentic scientific research workflows in a terminal

Agentic software engineering in open-source repositories

Reasoning & knowledge

Professional document reasoning, All-pass

Agentic coding & terminal use

Physics reasoning

Quantitative analysis on spreadsheets & documents

Legal agentic work, Hallucination-Gated All-Pass Rate

Agentic business operations

Agentic real-world work tasks, Elo

Agentic interactive 3D experiences, Elo

Product and brand videos designed in code, Elo

Kubernetes incident root-cause analysis

MLCR-AAUpdated

Medical long context reasoning

Visual reasoning

Rich, varied, well-crafted language

Well-structured, scannable, answer-first

Truthful, acknowledges uncertainty, non-sycophantic

Use of filler and generic language

More from Artificial Analysis