OpenBMB Models: Intelligence, Performance & Price
Artificial Analysis Intelligence Index
Per Intelligence Index Task
Per Intelligence Index Task
Artificial Analysis has benchmarked 4 models from OpenBMB. Below is a comparison of the key metrics across these models.
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Task
Cost
Cost per Intelligence Index Task
Speed & Latency
Time per Intelligence Index Task
Capability Scores
Capability Indexes
Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better
Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better
Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better
Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode 2.0, AA-Briefcase v1.1 · Higher is better
Incorporates 4 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf · Higher is better
All OpenBMB Releases
Further details
Weights | Provider Benchmarks | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MiniCPM-V 4.6 1.3B |  OpenBMB | - | 1.3B | 262k | - | - | - | - | ||
| MiniCPM5-2B | OpenBMB | - | 2.6B | 131k | - | - | - | - | ||
| MiniCPM5-1B (Reasoning) | OpenBMB | - | 1B | 128k | - | - | - | - | ||
| MiniCPM5-1B (Non-reasoning) | OpenBMB | - | 1B | 128k | - | - | - | - |