Gemma 4 26B A4B vs Claude 4.5 Haiku: Release Comparison
Comparison of the Gemma 4 26B A4B and Claude 4.5 Haiku releases: 2 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 4 models.
- For intelligence, Gemma 4 26B A4B and Claude 4.5 Haiku tie at 17 (Gemma 4 26B A4B (Reasoning) and Claude 4.5 Haiku (Reasoning)).
- For output speed, Claude 4.5 Haiku is fastest: Claude 4.5 Haiku (Reasoning) at 109 t/s, against Gemma 4 26B A4B (Non-reasoning) at 67 t/s for Gemma 4 26B A4B.
Releases compared
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Intelligence Index Task
Cost per Task (USD, Log Scale)
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indexes
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better
Further details
Input modality | Output modality | Weights | Provider Benchmarks | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Claude 4.5 Haiku (Reasoning) | 17 | 15 | 10 | 19 | 16 | 19 | 26 | $0.21 | $0.8 | $1.00 | $5.00 | $0.10 | $524 | 18k | 8k | 78M | 109 | 23.10s | 23.10s | 27.68s | 129.15s | - | 200k | Oct 2025 | Jul 2025 | Yes | Supports: text and image | Supports: text | Not available | - | |||
| Gemma 4 26B A4B (Reasoning) | 17 | - | - | - | - | - | - | - | $0.1 | $0.115 | $0.37 | $0.085 | - | - | - | - | - | - | - | - | - | 25.2B 3.8B active at inference time | 256k | Apr 2026 | - | Yes | Supports: text, image, and video | Supports: text | +4 | ||||
| Claude 4.5 Haiku (Non-reasoning) | 15 | - | - | - | - | - | - | - | $0.8 | $1.00 | $5.00 | $0.10 | - | - | - | - | 87 | 0.63s | 0.63s | 6.41s | - | - | 200k | Oct 2025 | Jul 2025 | No | Supports: text and image | Supports: text | Not available | - | |||
| Gemma 4 26B A4B (Non-reasoning) | 13 | - | - | - | - | - | - | - | $0.2 | $0.13 | $0.40 | $0.125 | - | - | - | - | 67 | 1.33s | 1.33s | 8.80s | - | 25.2B 3.8B active at inference time | 256k | Apr 2026 | - | No | Supports: text, image, and video | Supports: text | +4 | ||||