Name: Openness
Creator: Artificial Analysis
License: https://artificialanalysis.ai/docs/legal/Terms-of-Use.pdf

Openness

Artificial Analysis Openness Index: Score

Openness Index assesses model openness on a 0 to 100 normalized scale (higher is more open)

Reasoning models are indicated by a lightbulb icon

Progreso de los modelos con pesos abiertos

Progress in Open Weights vs. Proprietary Intelligence

Artificial Analysis Intelligence Index v4.1.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR

Reasoning models are indicated by a lightbulb icon

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Indicates whether the model weights are available. Models are labelled as 'Commercial Use Restricted' if the weights are available but commercial use is limited (typically requires obtaining a paid license).

Evolución de la inteligencia de los modelos de lenguaje con pesos abiertos por laboratorio

Reasoning models are indicated by a lightbulb icon

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Evolución de la inteligencia de los modelos con pesos abiertos por tamaño

Artificial Analysis Intelligence Index v4.1.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR

Reasoning models are indicated by a lightbulb icon

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Tiny: Less than or equal to 4B parameters. These are usually the smallest models in terms of resource demand.
Small: Less than 40B parameters.
Medium: Between 40B-150B parameters.
Large: Over 150B parameters.

Inteligencia

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.1.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR

Reasoning models are indicated by a lightbulb icon

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Intelligence Evaluations

Intelligence evaluations measured independently by Artificial Analysis · Higher is better

GDPval-AA v2

Agentic real-world work tasks, (Elo-500)/2000

𝜏³-BankingUpdated

Agentic tool use

Terminal-Bench v2.1

Agentic coding & terminal use

SciCode

Coding

Humanity's Last ExamUpdated

Reasoning & knowledge

GPQA Diamond

Scientific reasoning

CritPt

Physics reasoning

AA-Omniscience AccuracyUpdated

Knowledge

AA-Omniscience Non-Hallucination RateUpdated

1 - hallucination rate

AA-LCRUpdated

Long context reasoning

AA-Briefcase

Agentic knowledge work, Elo

AutomationBench-AA

Agentic SaaS workflows

Harvey LAB-AA

Legal agentic work, criterion pass rate

EnterpriseOps-Gym-AA

Agentic business operations

AA-AnalystAgentNew

Quantitative analysis on spreadsheets & documents

IFBench

Instruction following

APEX-Agents-AA

Long-horizon agentic tasks

ITBench-AA

Kubernetes incident root-cause analysis

MMMU-Pro

Visual reasoning

Reasoning models are indicated by a lightbulb icon

While model intelligence generally translates across use cases, specific evaluations may be more relevant for certain use cases.

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Tamaño

Intelligence Index por tamaño de modelo

Artificial Analysis Intelligence Index v4.1.1 incorporates 9 evaluations: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR

Reasoning models are indicated by a lightbulb icon

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Model Size: Total and Active Parameters

Comparison between total model parameters and parameters active during inference

Reasoning models are indicated by a lightbulb icon

The total number of trainable weights and biases in the model, expressed in billions. These parameters are learned during training and determine the model's ability to process and generate responses.

The number of parameters actually executed during each inference forward pass, expressed in billions. For Mixture of Experts (MoE) models, a routing mechanism selects a subset of experts per token, resulting in fewer active than total parameters. Dense models use all parameters, so active equals total.

Intelligence Index vs. Active Parameters

Artificial Analysis Intelligence Index · Active parameters at inference time

Most attractive quadrant

Pareto line

Reasoning models are indicated by a lightbulb icon

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

The number of parameters actually executed during each inference forward pass, expressed in billions. For Mixture of Experts (MoE) models, a routing mechanism selects a subset of experts per token, resulting in fewer active than total parameters. Dense models use all parameters, so active equals total.

Intelligence Index vs. Total Parameters

Artificial Analysis Intelligence Index · Size in parameters (billions)

Most attractive quadrant

Pareto line

Reasoning models are indicated by a lightbulb icon

Artificial Analysis Intelligence Index v4.1.1 includes: GDPval-AA v2, 𝜏³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

The total number of trainable weights and biases in the model, expressed in billions. These parameters are learned during training and determine the model's ability to process and generate responses.

Ventana de contexto

Context Window

Context window: tokens limit · Higher is better

Reasoning models are indicated by a lightbulb icon

Larger context windows are relevant to RAG (Retrieval Augmented Generation) LLM workflows which typically involve reasoning and information retrieval of large amounts of data.

Maximum number of combined input & output tokens. Output tokens commonly have a significantly lower limit (varied by model).

							Pesos		Benchmarks de proveedores
Kimi K3 (max)	Kimi	60	2.8T 104B activos en inferencia	1M	$2.3	39	🤗	+10	Ver
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)	DeepSeek	53	1.6T 49B activos en inferencia	1M	$0.7	84	🤗		Ver
GLM-5.2 (max)	Z AI	53	753B 40B activos en inferencia	1M	$0.9	136	🤗	+15	Ver
Motif 3	Motif Technologies	47	314B 13.2B activos en inferencia	262k	-	-	No disponible	-	Ver
MiniMax-M3	MiniMax	45	428B 23B activos en inferencia	1M	$0.2	117	🤗	+8	Ver
Inkling (xhigh)	Thinking Machines	42	975B 41B activos en inferencia	1M	$0.7	80	🤗	+2	Ver
Nemotron 3 Ultra 550B A55B (Reasoning)	NVIDIA	38	550B 55B activos en inferencia	262k	$0.5	151	🤗	+6	Ver
Solar Open2 250B	Upstage	37	250B	1M	-	-	No disponible	-	Ver
Muse Glimmer (high)	Meta	35	30B	131k	$0.2	103	🤗		Ver
K-EXAONE 2.0 0803	LG AI Research	31	750B 37B activos en inferencia	262k	-	-	No disponible	-	Ver
Mistral Medium 3.5	Mistral	30	128B	256k	$1.2	149	🤗		Ver
Nemotron 3 Super 120B A12B (Reasoning)	NVIDIA	26	120.6B 12.7B activos en inferencia	1M	$0.3	140	🤗		Ver
gpt-oss-120b (high)	OpenAI	24	117B 5.1B activos en inferencia	131k	$0.2	180	🤗	+16	Ver
Nemotron 3.5 Lightning	NVIDIA	24	31.6B 3.6B activos en inferencia	1M	$0.1	302	No disponible	+2	Ver
Command A+	Cohere	23	218B 25B activos en inferencia	192k	-	200	🤗		Ver

Comparación de modelos con pesos abiertos

Openness

Inteligencia

Parámetros totales

Openness

Artificial Analysis Openness Index: Score

Progreso de los modelos con pesos abiertos

Progress in Open Weights vs. Proprietary Intelligence

Evolución de la inteligencia de los modelos de lenguaje con pesos abiertos por laboratorio

Evolución de la inteligencia de los modelos con pesos abiertos por tamaño

Inteligencia

Artificial Analysis Intelligence Index

Intelligence Evaluations

Tamaño

Intelligence Index por tamaño de modelo

Model Size: Total and Active Parameters

Intelligence Index vs. Active Parameters

Intelligence Index vs. Total Parameters

Ventana de contexto

Context Window

Más detalles

Comparación de modelos con pesos abiertos

Openness

Inteligencia

Parámetros totales

Openness

Artificial Analysis Openness Index: Score

Progreso de los modelos con pesos abiertos

Progress in Open Weights vs. Proprietary Intelligence

Artificial Analysis Intelligence Index

Open Weights

Evolución de la inteligencia de los modelos de lenguaje con pesos abiertos por laboratorio

Artificial Analysis Intelligence Index

Evolución de la inteligencia de los modelos con pesos abiertos por tamaño

Artificial Analysis Intelligence Index

Model Size Classifications

Inteligencia

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index

Intelligence Evaluations

Intelligence Evaluation Relevance

Artificial Analysis Intelligence Index

Tamaño

Intelligence Index por tamaño de modelo

Artificial Analysis Intelligence Index

Model Size: Total and Active Parameters

Total Parameters

Active Parameters at Inference Time

Intelligence Index vs. Active Parameters

Artificial Analysis Intelligence Index

Active Parameters at Inference Time

Intelligence Index vs. Total Parameters

Artificial Analysis Intelligence Index

Total Parameters

Ventana de contexto

Context Window

Context Window for RAG

Context Window

Más detalles