Gemma 4 12B vs gpt-oss-20b: Release Comparison
Comparison of the Gemma 4 12B and gpt-oss-20b releases: 2 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 4 models.
- For intelligence, Gemma 4 12B scores highest: Gemma 4 12B (Reasoning) at 14, against gpt-oss-20b (low) at 10 for gpt-oss-20b.
- For output speed, gpt-oss-20b is fastest: gpt-oss-20b (low) at 224 t/s, against Gemma 4 12B (Reasoning) at 112 t/s for Gemma 4 12B.
Releases compared
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Intelligence Index Task
Cost per Task (USD, Log Scale)
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indexes
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better
Further details
Input modality | Output modality | Weights | Provider Benchmarks | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 12B (Reasoning) |  Google | 14 | - | - | - | - | - | - | - | $0.1 | $0.10 | $0.30 | - | - | - | - | - | 112 | 2.36s | 20.28s | 24.76s | - | 12B | 256k | Jun 2026 | - | Yes | Supports: text, image, speech, and video | Supports: text |  | |||
| gpt-oss-20b (low) |  OpenAI | 10 | - | - | - | - | - | - | - | $0.1 | $0.07 | $0.20 | - | - | - | - | - | 224 | 0.92s | 9.84s | 12.07s | - | 21B 3.6B active at inference time | 131k | Aug 2025 | May 2025 | Yes | Supports: text | Supports: text |    +5 | |||
| Gemma 4 12B (Non-reasoning) | Google | 9 | - | - | - | - | - | - | - | $0.1 | $0.10 | $0.30 | - | - | - | - | - | 110 | 2.34s | 2.34s | 6.88s | - | 12B | 262k | Jun 2026 | - | No | Supports: text, image, speech, and video | Supports: text | | |||
| gpt-oss-20b (high) | OpenAI | 9 | 7 | 5 | 7 | 7 | 12 | 11 | $0.01 | $0.1 | $0.06 | $0.19 | - | $29 | 18k | 16k | 70M | 182 | 0.85s | 11.86s | 14.61s | 104.99s | 21B 3.6B active at inference time | 131k | Aug 2025 | May 2024 | Yes | Supports: text | Supports: text |    +6 | |||