すべてのリリース•

10個のモデル

Allen Institute for AIのモデル:知能・性能・料金

Artificial AnalysisはAllen Institute for AIの10個のモデルをベンチマークしています。以下では、これらのモデルの主要指標を比較します。

  • 知能が最も高いAllen Institute for AIのモデルはOlmo 3.1 32B Think(7、推定)です。

知能

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index とタスクあたりのコスト

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
No data available

費用

Intelligence Index タスクあたりのコスト

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No data available

速度と遅延

出力速度

Output tokens per second · Higher is better
No data available

能力スコア

能力指数

特定の能力や業界におけるモデルの性能を測定
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

No data available
Strategy & Ops Index

Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

No data available
Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

No data available
Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

No data available
Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

No data available
Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

No data available

Allen Institute for AIのすべてのリリース

詳細

ウェイト
プロバイダーのベンチマーク
Llama 3.1 Tulu3 405B
Allen Institute for AIのロゴAllen Institute for AI
7
405B
128k
-
-
-
Olmo 3.1 32B Think
Allen Institute for AIのロゴAllen Institute for AI
7
32.2B
66k
-
-
-
Olmo 3.1 32B Instruct
Allen Institute for AIのロゴAllen Institute for AI
6
32.2B
66k
-
-
-
Olmo 3 32B Think
Allen Institute for AIのロゴAllen Institute for AI
6
32.2B
66k
-
-
-
OLMo 2 32B
Allen Institute for AIのロゴAllen Institute for AI
6
32.2B
4k
-
-
-
Olmo 3 7B Think
Allen Institute for AIのロゴAllen Institute for AI
6
7B
66k
-
-
-
OLMo 2 7B
Allen Institute for AIのロゴAllen Institute for AI
6
7.3B
4k
-
-
-
Molmo 7B-D
Allen Institute for AIのロゴAllen Institute for AI
6
8.0B
4k
-
-
-
Olmo 3 7B Instruct
Allen Institute for AIのロゴAllen Institute for AI
5
7B
66k
-
-
-
Molmo2-8B
Allen Institute for AIのロゴAllen Institute for AI
5
8.7B
37k
-
-
-