Allen Institute for AI Models: Intelligence, Performance & Price
Artificial Analysis Intelligence Index
* Estimated
Per Intelligence Index Task
Artificial Analysis has benchmarked 10 models from Allen Institute for AI. Below is a comparison of the key metrics across these models.
- For intelligence, the top model from Allen Institute for AI is Olmo 3.1 32B Think at 7 (estimated).
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Task
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indexes
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better
All Allen Institute for AI Releases
Olmo 3.1 32B Instruct
1 model
6
Highest Intelligence
Olmo 3.1 32B Think
1 model
7
Highest Intelligence
Molmo2-8B
1 model
5
Highest Intelligence
Olmo 3 32B Think
1 model
6
Highest Intelligence
Olmo 3 7B Instruct
1 model
5
Highest Intelligence
Olmo 3 7B Think
1 model
6
Highest Intelligence
OLMo 2 32B
1 model
6
Highest Intelligence
Llama 3.1 Tulu3 405B
1 model
7
Highest Intelligence
OLMo 2 7B
1 model
6
Highest Intelligence
Molmo 7B-D
1 model
6
Highest Intelligence
Further details
Weights | Provider Benchmarks | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Llama 3.1 Tulu3 405B | Allen Institute for AI | 7 | 405B | 128k | - | - | - | ||
| Olmo 3.1 32B Think | Allen Institute for AI | 7 | 32.2B | 66k | - | - | - | ||
| Olmo 3.1 32B Instruct | Allen Institute for AI | 6 | 32.2B | 66k | - | - | - | ||
| Olmo 3 32B Think | Allen Institute for AI | 6 | 32.2B | 66k | - | - | - | ||
| OLMo 2 32B | Allen Institute for AI | 6 | 32.2B | 4k | - | - | - | ||
| Olmo 3 7B Think | Allen Institute for AI | 6 | 7B | 66k | - | - | - | ||
| OLMo 2 7B | Allen Institute for AI | 6 | 7.3B | 4k | - | - | - | ||
| Molmo 7B-D | Allen Institute for AI | 6 | 8.0B | 4k | - | - | - | ||
| Olmo 3 7B Instruct | Allen Institute for AI | 5 | 7B | 66k | - | - | - | ||
| Molmo2-8B | Allen Institute for AI | 5 | 8.7B | 37k | - | - | - |