This model is deprecated. We only continue performance benchmarking for the default 10k input token workload. Results for other workloads are historical and no longer updated.

Allen Institute for AI has launched a newer release, Olmo 3 32B Think. We suggest considering it instead.

•

Open weights model

•

Released March 2025

OLMo 2 32B Intelligence, Performance & Price Analysis

Model summary

Intelligence

6*
Artificial Analysis Intelligence Index

* Estimated

2 out of 4 units for Intelligence.

Speed

N/A
Output tokens per second
Unknown out of 4 units for Speed.
In -Out -
N/A
Cost per Intelligence Index task
Unknown out of 4 units for Cost.

Verbosity

N/A
Output tokens from Intelligence Index
Unknown out of 4 units for Verbosity.

Artificial Analysis Intelligence Index · Higher is better

Speed

Output tokens per second · Higher is better
Weighted average cost (USD) per Intelligence Index task · Lower is better

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
No publicly available API
Estimate (independent evaluation forthcoming)

Artificial Analysis Intelligence Index by Open Weights / Proprietary

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
No publicly available API
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Evaluations

Evaluations measured independently by Artificial Analysis · AA-PersonalityBench scores are percentile ranks from 1 to 100
See more
No publicly available API

Agentic knowledge work, Elo

Agentic SaaS workflows

Agentic real-world work tasks, Elo

Reasoning & knowledge

Professional document reasoning, All-pass

Agentic coding & terminal use

Long context reasoning

SciCodeUnder review

Coding

Physics reasoning

Agentic scientific research workflows in a terminal

Agentic software engineering in open-source repositories

Quantitative analysis on spreadsheets & documents

Legal agentic work, Hallucination-Gated All-Pass Rate

Agentic business operations

Agentic interactive 3D experiences, Elo

Kubernetes incident root-cause analysis

MLCR-AAUpdated

Medical long context reasoning

Visual reasoning

Rich, varied, well-crafted language

Well-structured, scannable, answer-first

Truthful, acknowledges uncertainty, non-sycophantic

Use of filler and generic language

Openness Index

Artificial Analysis Openness Index: Score

Openness Index assesses model openness on a 0 to 100 normalized scale (higher is more open)

Intelligence Index Comparisons

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Cost to Run Artificial Analysis Intelligence Index

Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens)

Context Window

Context Window

Context window: tokens limit · Higher is better
No publicly available API

Model Size (Open Weights Models Only)

Model Size: Total and Active Parameters

Comparison between total model parameters and parameters active during inference (billions)

Frequently Asked Questions

Common questions about OLMo 2 32B