Indexes

AA-LCR v1.1AutomationBench-AATerminal-Bench 4.0SciCodeHumanity's Last ExamGDP.pdfCritPt

Artificial Analysis Intelligence Index v4.3.2

A composite benchmark aggregating ten challenging evaluations to provide a holistic measure of AI capabilities across mathematics, science, coding, and reasoning.

BusinessFinanceLegalMedicalHumanitiesCodingScienceMathAgenticKnowledge WorkTool UseWritingReasoningInstruction FollowingMultimodalLong ContextFaithfulness
Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index

A composite index of coding agent performance on end-to-end software engineering tasks, compared across agents, models and execution settings.

CodingAgenticTool UseReasoningInstruction Following
Artificial Analysis Search Index

Artificial Analysis Search Index

A composite index of Search API quality in agentic search, pairing every provider with the same answer model to measure its uplift.

FaithfulnessReasoningAgenticTool Use
Cyber Index Alliance Launch ArticleCWE-bench (Collinear AI)DeepsecBench (Vercel)CyberGym-E2E (Berkeley RDI)
New

Artificial Analysis Cyber Index

A composite index of model capability on cyber defense, combining three evaluations of finding and fixing vulnerabilities in real software repositories.

CodingAgenticTool UseReasoning
AA-Omniscience-DecisionHLE-MultiChoiceWhen2CallWildGuardTest
New

Artificial Analysis Decision Index

A composite index testing decision models across classification, tool calling, knowledge and reasoning.

HumanitiesBusinessFinanceLegalMedicalScienceMathFaithfulnessReasoningTool Use
Open Source Models

Artificial Analysis Openness Index

A composite measure providing an industry standard to communicate model openness for users and developers.

AA-LCR v1.1Humanity's Last ExamAutomationBench-AAGDP.pdf

Finance & Accounting Index

Measures performance on the finance and accounting domain, including business knowledge, agentic knowledge work, reasoning, agentic tool use, long-context analysis, and non-hallucination.

FinanceBusinessAgenticKnowledge WorkReasoningTool UseLong ContextFaithfulness
AA-LCR v1.1AutomationBench-AAGDP.pdf

Strategy & Ops Index

Measures performance on the strategy and operations domain, including business knowledge, agentic knowledge work, agentic tool use across business apps, and long-context analysis.

BusinessAgenticKnowledge WorkTool UseLong Context
AA-LCR v1.1Humanity's Last ExamGDP.pdfAutomationBench-AA

Legal Index

Measures performance on the legal domain, including legal knowledge, agentic knowledge work, reasoning, long-context document analysis, non-hallucination, and agentic tool use.

LegalAgenticKnowledge WorkReasoningLong ContextFaithfulnessTool Use
AA-Briefcase v1.1MLCR-AAHumanity's Last ExamAutomationBench-AA

Healthcare & Medical Index

Measures performance on the medical and healthcare domain, including clinical knowledge, agentic knowledge work, long-context reasoning over patient records, non-hallucination, clinical reasoning, and agentic tool use.

MedicalAgenticKnowledge WorkLong ContextFaithfulnessReasoningTool Use
AA-Briefcase v1.1Humanity's Last ExamCritPtTerminal-Bench 4.0

Engineering Index

Measures performance on the engineering domain, including engineering knowledge, quantitative reasoning, agentic execution, and terminal use.

ScienceReasoningAgenticKnowledge WorkCoding
AA-LCR v1.1Humanity's Last Exam

Economics Index

Measures performance on the economics domain, including economics knowledge, quantitative reasoning, agentic execution, and long-context analysis.

BusinessReasoningAgenticKnowledge WorkLong Context