Allen Institute for AI-Modelle: Intelligenz, Leistung und Preis

Artificial Analysis hat 10 Modelle von Allen Institute for AI gebenchmarkt. Unten werden die wichtigsten Kennzahlen dieser Modelle verglichen.

IntelligenzUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1
No data available

Intelligence Index vs. Kosten pro Aufgabe

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
No data available

Kosten

Kosten pro Aufgabe des Intelligence Index

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No data available

Geschwindigkeit und Latenz

Zeit pro Aufgabe des Intelligence Index

Output tokens divided by end-to-end output speed (minutes per Intelligence Index task) · Speed at the model's own endpoint or the median across providers · Lower is better
No data available

Fähigkeitswerte

Fähigkeitsindizes

Misst die Leistung von Modellen bei bestimmten Fähigkeiten und in bestimmten Branchen
Finance & Accounting Index

Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better

No data available
Strategy & Ops Index

Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better

No data available
Legal Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better

No data available
Healthcare & Medical Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better

No data available
Engineering Index

Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode 2.0, AA-Briefcase v1.1 · Higher is better

No data available
Economics Index

Incorporates 4 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf · Higher is better

No data available

Alle Veröffentlichungen von Allen Institute for AI

Weitere Details

Gewichte
Anbieter-Benchmarks
Olmo 3 7B Think
Logo von Allen Institute for AIAllen Institute for AI
-
7B
66k
-
-
-
-
Olmo 3.1 32B Think
Logo von Allen Institute for AIAllen Institute for AI
-
32.2B
66k
-
-
-
-
Molmo2-8B
Logo von Allen Institute for AIAllen Institute for AI
-
8.7B
37k
-
-
-
-
OLMo 2 32B
Logo von Allen Institute for AIAllen Institute for AI
-
32.2B
4k
-
-
-
-
Olmo 3 7B Instruct
Logo von Allen Institute for AIAllen Institute for AI
-
7B
66k
-
-
-
-
Olmo 3.1 32B Instruct
Logo von Allen Institute for AIAllen Institute for AI
-
32.2B
66k
-
-
-
-
Molmo 7B-D
Logo von Allen Institute for AIAllen Institute for AI
-
8.0B
4k
-
-
-
-
Olmo 3 32B Think
Logo von Allen Institute for AIAllen Institute for AI
-
32.2B
66k
-
-
-
-
Llama 3.1 Tulu3 405B
Logo von Allen Institute for AIAllen Institute for AI
-
405B
128k
-
-
-
-
OLMo 2 7B
Logo von Allen Institute for AIAllen Institute for AI
-
7.3B
4k
-
-
-
-