Indexes

AA-Omniscience v1.1AutomationBench-AATerminal-Bench 4.0FrontierCode 2.0GDP.pdfHLE-DiamondCritPt v2 (Hard Subset)Terminal-Bench-Science 0.1
Updated

Artificial Analysis Intelligence Index v5.0

A composite benchmark aggregating nine challenging evaluations to provide a holistic measure of AI capabilities across knowledge work, coding, science, and general knowledge.

BusinessCodingHumanitiesFinanceLegalMedicalScienceMathAgenticKnowledge WorkTool UseWritingReasoningInstruction FollowingFaithfulnessMultimodalLong Context
Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index

A composite index of coding agent performance on end-to-end software engineering tasks, compared across agents, models and execution settings.

CodingAgenticTool UseReasoningInstruction Following
Artificial Analysis Search Index

Artificial Analysis Search Index

A composite index of Search API quality in agentic search, pairing every provider with the same answer model to measure its uplift.

FaithfulnessReasoningAgenticTool Use
Cyber Index Alliance Launch ArticleCWE-bench (Collinear AI)DeepsecBench (Vercel)CyberGym-E2E (Berkeley RDI)

Artificial Analysis Cyber Index

A composite index of model capability on cyber defense, combining three evaluations of finding and fixing vulnerabilities in real software repositories.

CodingAgenticTool UseReasoning
AA-Omniscience-DecisionHLE-MultiChoiceWhen2CallWildGuardTest
New

Artificial Analysis Decision Index

A composite index testing decision models across classification, tool calling, knowledge and reasoning.

HumanitiesBusinessFinanceLegalMedicalScienceMathFaithfulnessReasoningTool Use
Open Source Models

Artificial Analysis Openness Index

A composite measure providing an industry standard to communicate model openness for users and developers.

AA-Omniscience v1.1HLE-DiamondAutomationBench-AAGDP.pdf

Finance & Accounting Index

Measures performance on the finance and accounting domain, including business knowledge, agentic knowledge work, reasoning, agentic tool use, long-context analysis, and non-hallucination.

FinanceBusinessAgenticKnowledge WorkReasoningFaithfulnessTool UseLong Context
AutomationBench-AAAA-Omniscience v1.1GDP.pdf

Strategy & Ops Index

Measures performance on the strategy and operations domain, including business knowledge, agentic knowledge work, agentic tool use across business apps, long-context analysis, and non-hallucination.

BusinessAgenticTool UseKnowledge WorkLong ContextFaithfulness
AA-Briefcase v1.1HLE-DiamondGDP.pdfAutomationBench-AA

Legal Index

Measures performance on the legal domain, including legal knowledge, agentic knowledge work, reasoning, long-context document analysis, non-hallucination, and agentic tool use.

LegalAgenticKnowledge WorkReasoningFaithfulnessLong ContextTool Use
AA-Briefcase v1.1MLCR-AAAutomationBench-AAHLE-Diamond

Healthcare & Medical Index

Measures performance on the medical and healthcare domain, including clinical knowledge, agentic knowledge work, long-context reasoning over patient records, non-hallucination, clinical reasoning, and agentic tool use.

MedicalAgenticKnowledge WorkLong ContextTool UseFaithfulnessReasoning
AA-Briefcase v1.1CritPt v2 (Hard Subset)Terminal-Bench-Science 0.1HLE-DiamondTerminal-Bench 4.0FrontierCode 2.0

Engineering Index

Measures performance on the engineering domain, including engineering knowledge, science, reasoning, agentic coding, and agentic knowledge work.

ScienceReasoningAgenticCodingKnowledge Work
AA-Omniscience v1.1HLE-DiamondGDP.pdf

Economics Index

Measures performance on the economics domain, including economics knowledge, quantitative reasoning, agentic execution, and long-context analysis.

BusinessAgenticKnowledge WorkReasoningLong Context