すべてのリリース•

13個のモデル

IBMのモデル:知能・性能・料金

Artificial AnalysisはIBMの13個のモデルをベンチマークしています。以下では、これらのモデルの主要指標を比較します。

  • 知能が最も高いIBMのモデルはGranite 4.2 30B(15、推定)です。
  • 出力速度が最も速いモデルはGranite 4.2 3B(216トークン/秒)です。
  • 最初の回答トークンまでの時間が最も短いモデルはGranite 4.2 3B(9.77秒)です。
  • タスクあたりの費用が最も低いモデルはGranite 4.2 3B($0.01)です。モデル間の料金差は最大3.9倍です。

知能

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Intelligence Index Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

費用

Cost per Intelligence Index Task

Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better

速度と遅延

Output Speed

Output tokens per second · Higher is better

能力スコア

能力指数

特定の能力や業界におけるモデルの性能を測定
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

No data available
Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

IBMのすべてのリリース

詳細

ウェイト
プロバイダーのベンチマーク
Granite 4.2 30B
IBMのロゴIBM
15
30B
131k
$0.1
77
DeepInfra
Granite 4.2 8B
IBMのロゴIBM
11
8B
131k
$0.0
76
CoreWeaveDeepInfra
Granite 4.2 3B
IBMのロゴIBM
9
3B
131k
$0.0
216
DeepInfra
Granite 4.1 30B
IBMのロゴIBM
7
30B
131k
-
-
-
Granite 4.1 8B
IBMのロゴIBM
7
8B
131k
$0.1
126
CoreWeave
Granite 4.0 H Small
IBMのロゴIBM
6
32B
推論時に9Bが有効
128k
$0.1
15
Replicate
Granite 4.1 3B
IBMのロゴIBM
6
3B
131k
-
-
-
Granite 4.0 H 1B
IBMのロゴIBM
5
1.5B
128k
-
-
-
Granite 4.0 Micro
IBMのロゴIBM
5
3B
128k
-
-
-
Granite 4.0 1B
IBMのロゴIBM
5
1.6B
128k
-
-
-
Granite 3.3 8B (Non-reasoning)
IBMのロゴIBM
5
8.2B
128k
$0.1
15
Replicate
Granite 4.0 350M
IBMのロゴIBM
5
0.3B
33k
-
-
-
Granite 4.0 H 350M
IBMのロゴIBM
5
0.3B
33k
-
-
-