Indexes

AA-Omniscience v1.1AutomationBench-AATerminal-Bench 4.0FrontierCode 2.0GDP.pdfHLE-DiamondCritPt v2 (Hard Subset)Terminal-Bench-Science 0.1
Updated

Artificial Analysis Intelligence Index v5.0.1

A composite benchmark aggregating nine challenging evaluations to provide a holistic measure of AI capabilities across knowledge work, coding, science, and general knowledge.

BusinessCodingHumanitiesFinanceLegalMedicalScienceMathAgenticKnowledge WorkTool UseWritingReasoningInstruction FollowingFaithfulnessMultimodalLong Context
Artificial Analysis Progress Index v1
New

Artificial Analysis Progress Index v1

Language model capability on one scale that stays consistent over time, estimated with item response theory so models released years apart can be compared.

Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index

A composite index of coding agent performance on end-to-end software engineering tasks, compared across agents, models and execution settings.

CodingAgenticTool UseReasoningInstruction Following
Artificial Analysis Search Index

Artificial Analysis Search Index

A composite index of Search API quality in agentic search, pairing every provider with the same answer model to measure its uplift.

FaithfulnessReasoningAgenticTool Use
Cyber Index Alliance Launch ArticleCWE-bench (Collinear AI)DeepsecBench (Vercel)CyberGym-E2E (Berkeley RDI)

Artificial Analysis Cyber Index

A composite index of model capability on cyber defense, combining three evaluations of finding and fixing vulnerabilities in real software repositories.

CodingAgenticTool UseReasoning
AA-Omniscience-DecisionHLE-MultiChoiceWhen2CallWildGuardTest
New

Artificial Analysis Decision Index

A composite index testing decision models across classification, tool calling, knowledge and reasoning.

HumanitiesBusinessFinanceLegalMedicalScienceMathFaithfulnessReasoningTool Use
Open Source Models

Artificial Analysis Openness Index

A composite measure providing an industry standard to communicate model openness for users and developers.

AA-Omniscience v1.1HLE-DiamondAutomationBench-AAGDP.pdf

Finance & Accounting Index

Measures performance on the finance and accounting domain, including business knowledge, agentic knowledge work, reasoning, agentic tool use, long-context analysis, and non-hallucination.

FinanceBusinessAgenticKnowledge WorkReasoningFaithfulnessTool UseLong Context
AutomationBench-AAAA-Omniscience v1.1GDP.pdf

Strategy & Ops Index

Measures performance on the strategy and operations domain, including business knowledge, agentic knowledge work, agentic tool use across business apps, long-context analysis, and non-hallucination.

BusinessAgenticTool UseKnowledge WorkLong ContextFaithfulness
AA-Briefcase v1.1HLE-DiamondGDP.pdfAutomationBench-AA

Legal Index

Measures performance on the legal domain, including legal knowledge, agentic knowledge work, reasoning, long-context document analysis, non-hallucination, and agentic tool use.

LegalAgenticKnowledge WorkReasoningFaithfulnessLong ContextTool Use
AA-Briefcase v1.1MLCR-AAAutomationBench-AAHLE-Diamond

Healthcare & Medical Index

Measures performance on the medical and healthcare domain, including clinical knowledge, agentic knowledge work, long-context reasoning over patient records, non-hallucination, clinical reasoning, and agentic tool use.

MedicalAgenticKnowledge WorkLong ContextTool UseFaithfulnessReasoning
AA-Briefcase v1.1CritPt v2 (Hard Subset)Terminal-Bench-Science 0.1HLE-DiamondTerminal-Bench 4.0FrontierCode 2.0

Engineering Index

Measures performance on the engineering domain, including engineering knowledge, science, reasoning, agentic coding, and agentic knowledge work.

ScienceReasoningAgenticCodingKnowledge Work
AA-Briefcase v1.1HLE-DiamondGDP.pdf

Economics Index

Measures performance on the economics domain, including economics knowledge, quantitative reasoning, agentic execution, and long-context analysis.

BusinessAgenticKnowledge WorkReasoningLong Context