Gemma 4 12B vs Grok 4.3: Release Comparison
Comparison of the Gemma 4 12B and Grok 4.3 releases: 2 and 4 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 6 models.
- For intelligence, Grok 4.3 scores highest: Grok 4.3 (high) at 25, against Gemma 4 12B (Reasoning) at 14 for Gemma 4 12B.
- For output speed, Grok 4.3 is fastest: Grok 4.3 (high) at 114 t/s, against Gemma 4 12B (Reasoning) at 109 t/s for Gemma 4 12B.
Releases compared
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Intelligence Index Task
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indices
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2, AA-Briefcase, Terminal-Bench 4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2, AA-Briefcase, AA-LCR v1.1 · Higher is better
Further details
Input modality | Output modality | Weights | Provider Benchmarks | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Grok 4.3 (high) |  SpaceXAI | 25 | 28 | 18 | 33 | 27 | 31 | 41 | $0.17 | $0.6 | $1.25 | $2.50 | $0.20 | $332 | 18k | 11k | 87M | 114 | 18.32s | 18.32s | 22.71s | 155.89s | - | 1M | Apr 2026 | - | Yes | Supports: text and image | Supports: text | Not available | - |   | |
| Grok 4.3 (medium) | SpaceXAI | 25 | - | - | - | - | - | - | - | $0.6 | $1.25 | $2.50 | $0.20 | - | - | - | - | 108 | 12.57s | 12.57s | 17.21s | - | - | 1M | Apr 2026 | - | Yes | Supports: text and image | Supports: text | Not available | - | | |
| Grok 4.3 (low) | SpaceXAI | 24 | - | - | - | - | - | - | - | $0.6 | $1.25 | $2.50 | $0.20 | - | - | - | - | 102 | 4.55s | 4.55s | 9.43s | - | - | 1M | Apr 2026 | - | Yes | Supports: text and image | Supports: text | Not available | - | | |
| Grok 4.3 (Non-reasoning) | SpaceXAI | 15 | 16 | 14 | 19 | - | 15 | 21 | $0.14 | $0.6 | $1.25 | $2.50 | $0.20 | $203 | 9k | 0 | 12M | 108 | 0.70s | 0.70s | 5.32s | 86.55s | - | 1M | Apr 2026 | - | No | Supports: text and image | Supports: text | Not available | - | | |
| Gemma 4 12B (Reasoning) |  Google | 14 | - | - | - | - | - | - | - | $0.1 | $0.10 | $0.30 | - | - | - | - | - | 109 | 2.43s | 20.75s | 25.33s | - | 12B | 256k | Jun 2026 | - | Yes | Supports: text, image, speech, and video | Supports: text |  | |||
| Gemma 4 12B (Non-reasoning) | Google | 9 | - | - | - | - | - | - | - | $0.1 | $0.10 | $0.30 | - | - | - | - | - | 105 | 2.39s | 2.39s | 7.14s | - | 12B | 262k | Jun 2026 | - | No | Supports: text, image, speech, and video | Supports: text | | |||