All Releases•

13 models

IBM Models: Intelligence, Performance & Price

Artificial Analysis has benchmarked 13 models from IBM. Below is a comparison of the key metrics across these models.

  • For intelligence, the top model from IBM is Granite 4.2 30B at 15 (estimated).
  • For output speed, the fastest model is Granite 4.2 3B at 216 t/s.
  • For latency, Granite 4.2 3B at 9.77s offers the lowest time to first answer token.
  • For pricing, Granite 4.2 3B at $0.01 offers the lowest cost per task. Prices vary up to 3.9x across models.

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Intelligence Index Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better

Speed & Latency

Output Speed

Output tokens per second · Higher is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

No data available
Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

All IBM Releases

Further details

Weights
Provider Benchmarks
Granite 4.2 30B
IBM logoIBM
15
30B
131k
$0.1
77
DeepInfra
Granite 4.2 8B
IBM logoIBM
11
8B
131k
$0.0
76
CoreWeaveDeepInfra
Granite 4.2 3B
IBM logoIBM
9
3B
131k
$0.0
216
DeepInfra
Granite 4.1 30B
IBM logoIBM
7
30B
131k
-
-
-
Granite 4.1 8B
IBM logoIBM
7
8B
131k
$0.1
126
CoreWeave
Granite 4.0 H Small
IBM logoIBM
6
32B
9B active at inference time
128k
$0.1
15
Replicate
Granite 4.1 3B
IBM logoIBM
6
3B
131k
-
-
-
Granite 4.0 H 1B
IBM logoIBM
5
1.5B
128k
-
-
-
Granite 4.0 Micro
IBM logoIBM
5
3B
128k
-
-
-
Granite 4.0 1B
IBM logoIBM
5
1.6B
128k
-
-
-
Granite 3.3 8B (Non-reasoning)
IBM logoIBM
5
8.2B
128k
$0.1
15
Replicate
Granite 4.0 350M
IBM logoIBM
5
0.3B
33k
-
-
-
Granite 4.0 H 350M
IBM logoIBM
5
0.3B
33k
-
-
-