All Releases•

13 models

IBM Models: Intelligence, Performance & Price

Artificial Analysis has benchmarked 13 models from IBM. Below is a comparison of the key metrics across these models.

  • For intelligence, the top model from IBM is Granite 4.2 30B at 13.
  • For output speed, the fastest model is Granite 4.2 3B at 218 t/s.
  • For latency, Granite 4.2 3B at 9.68s offers the lowest time to first answer token.
  • For pricing, Granite 4.2 3B at $0.01 offers the lowest cost per task. Prices vary up to 12x across models.

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Speed & Latency

Output Speed

Output tokens per second · Higher is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

No data available
Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

All IBM Releases

Further details

Weights
Provider Benchmarks
Granite 4.2 30B
IBM logoIBM
13
30B
131k
$0.1
77
DeepInfra
Granite 4.2 8B
IBM logoIBM
11
8B
131k
$0.0
128
CoreWeaveDeepInfra
Granite 4.2 3B
IBM logoIBM
9
3B
131k
$0.0
218
DeepInfra
Granite 4.1 30B
IBM logoIBM
7
30B
131k
-
-
-
Granite 4.1 8B
IBM logoIBM
7
8B
131k
-
-
-
Granite 4.0 H Small
IBM logoIBM
6
32B
9B active at inference time
128k
-
-
-
Granite 4.1 3B
IBM logoIBM
6
3B
131k
-
-
-
Granite 4.0 H 1B
IBM logoIBM
5
1.5B
128k
-
-
-
Granite 4.0 Micro
IBM logoIBM
5
3B
128k
-
-
-
Granite 4.0 1B
IBM logoIBM
5
1.6B
128k
-
-
-
Granite 3.3 8B (Non-reasoning)
IBM logoIBM
5
8.2B
128k
$0.1
9
Replicate
Granite 4.0 350M
IBM logoIBM
5
0.3B
33k
-
-
-
Granite 4.0 H 350M
IBM logoIBM
5
0.3B
33k
-
-
-