Modelos de Allen Institute for AI: inteligência, desempenho e preço

A Artificial Analysis avaliou 10 modelos de Allen Institute for AI. Abaixo, comparamos as principais métricas desses modelos.

  • Em inteligência, o principal modelo de Allen Institute for AI é Olmo 3.1 32B Think, com 7 (estimativa).

Inteligência

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Intelligence Index Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
No data available

Custo

Cost per Intelligence Index Task

Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better
No data available

Velocidade e latência

Output Speed

Output tokens per second · Higher is better
No data available

Pontuações de capacidades

Índices de capacidades

Mede o desempenho dos modelos em capacidades e setores específicos
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

No data available
Strategy & Ops Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

No data available
Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

No data available
Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

No data available
Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

No data available
Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

No data available

Todos os lançamentos de Allen Institute for AI

Mais detalhes

Pesos
Benchmarks de provedores
Llama 3.1 Tulu3 405B
Logo: Allen Institute for AIAllen Institute for AI
7
405B
128k
-
-
-
Olmo 3.1 32B Think
Logo: Allen Institute for AIAllen Institute for AI
7
32.2B
66k
US$ 0,0
-
Parasail
Olmo 3.1 32B Instruct
Logo: Allen Institute for AIAllen Institute for AI
6
32.2B
66k
-
-
-
Olmo 3 32B Think
Logo: Allen Institute for AIAllen Institute for AI
6
32.2B
66k
-
-
-
OLMo 2 32B
Logo: Allen Institute for AIAllen Institute for AI
6
32.2B
4k
-
-
-
Olmo 3 7B Think
Logo: Allen Institute for AIAllen Institute for AI
6
7B
66k
-
-
-
OLMo 2 7B
Logo: Allen Institute for AIAllen Institute for AI
6
7.3B
4k
-
-
-
Molmo 7B-D
Logo: Allen Institute for AIAllen Institute for AI
6
8.0B
4k
-
-
-
Olmo 3 7B Instruct
Logo: Allen Institute for AIAllen Institute for AI
5
7B
66k
US$ 0,1
-
Parasail
Molmo2-8B
Logo: Allen Institute for AIAllen Institute for AI
5
8.7B
37k
-
-
-