Artificial Analysis AI Trends

Analysis of the current state of AI and the key trends driving progress. Includes analysis of the intelligence of models, their efficiency, architecture, inference speed and cost and trends in training.

AI Progress

Tracking the continued advancement of AI, and the position of each of the leading AI companies.

Frontier Language Model Intelligence, Over Time

Artificial Analysis Intelligence Index v4.3 incorporates 10 evaluations: AA-Briefcase, GDPval-AA v2, AutomationBench-AA, Terminal-Bench v4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1

Capital Expenditure by Major Tech Companies, Over Time

Capital expenditure by quarter (in billions of USD)

Intelligence Index vs. Release Date

Artificial Analysis Intelligence Index · Release date
Most attractive region

Leading Models by AI Lab

Highest Artificial Analysis Intelligence Index achieved by each AI lab

Efficiency

Analysis of how efficiency of AI is developing. This includes considering how the cost of achieving levels of intelligence and the speed at which this intelligence is accessible are trending.

Language Model Inference Price, by Intelligence Index Band, Over Time

Price in USD per 1M tokens (7:2:1 blend of cache, input, and output token prices). Bands use Artificial Analysis Intelligence Index v4.3.

Language Model Output Speed, by Intelligence Index Band, Over Time

Output tokens per second. Bands use Artificial Analysis Intelligence Index v4.3.

Country Analysis

AI is a global phenomenon. We share perspectives on where AI progress is happening and how the leading models from countries compare. We deep-dive on the US and China as the two leading hubs for AI development.

Frontier Language Model Intelligence By Country, Over Time

Artificial Analysis Intelligence Index v4.3 incorporates 10 evaluations: AA-Briefcase, GDPval-AA v2, AutomationBench-AA, Terminal-Bench v4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1

Open Weights: Frontier Language Model Intelligence By Country, Over Time

Artificial Analysis Intelligence Index v4.3 incorporates 10 evaluations: AA-Briefcase, GDPval-AA v2, AutomationBench-AA, Terminal-Bench v4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1

Leading Models by Country

Artificial Analysis Intelligence Index · Leading models

Open Source Models

Open weights models offer flexibility in deployment and the ability to fine-tune the models for specific use cases. We analyze the leading open weights models and how intelligence compares to proprietary models.

Progress in Open Weights vs. Proprietary Intelligence

Artificial Analysis Intelligence Index v4.3 incorporates 10 evaluations: AA-Briefcase, GDPval-AA v2, AutomationBench-AA, Terminal-Bench v4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1

Artificial Analysis Intelligence Index by Open Weights / Proprietary

Artificial Analysis Intelligence Index v4.3 incorporates 10 evaluations: AA-Briefcase, GDPval-AA v2, AutomationBench-AA, Terminal-Bench v4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1

Model Architecture

The architecture of AI models influences their performance and efficiency. This section examines architectural trends in models, such as the rise in popularity of the Mixture of Experts (MoE) architecture, and how these relate to model capabilities.

Intelligence Index vs. Release Date by Model Architecture

Artificial Analysis Intelligence Index, open weights models only
Most attractive region

Model Size: Total and Active Parameters

Comparison between total model parameters and parameters active during inference

Intelligence Index vs. Active Parameters

Artificial Analysis Intelligence Index · Active parameters at inference time
Most attractive quadrant
Pareto line

Intelligence Index vs. Total Parameters

Artificial Analysis Intelligence Index · Size in parameters (billions)
Most attractive quadrant
Pareto line

Context Length (Tokens), Median By Quarter

Median context length (thousand tokens)

Training Analysis

Our analysis of trends in the training of AI models includes consideration of both trends in the size of training runs as well as the relationship between the size of the training run and the intelligence of the model.

Training Tokens By Model

Training tokens in trillions
No data available

Intelligence Index vs. Training Tokens

Artificial Analysis Intelligence Index v4.3 incorporates 10 evaluations: AA-Briefcase, GDPval-AA v2, AutomationBench-AA, Terminal-Bench v4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1 · Training tokens in trillions
Most attractive quadrant
No data available