Gemma 4 12B vs Qwen3.5 4B: Release Comparison
Comparison of the Gemma 4 12B and Qwen3.5 4B releases: 2 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 4 models.
- For intelligence, Gemma 4 12B scores highest: Gemma 4 12B (Reasoning) at 22, against Qwen3.5 4B (Reasoning) at 20 for Qwen3.5 4B.
- For output speed, Gemma 4 12B is fastest: Gemma 4 12B (Non-reasoning) at 105 t/s, against Qwen3.5 4B (Reasoning) at 27 t/s for Qwen3.5 4B.
Releases compared
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Intelligence Index Task
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indices
Measures performance in agentic workflows, focusing on behaviors like tool use, planning, autonomy, and complex problem solving.
Incorporates 5 evaluations: AA-Omniscience, GDPval-AA v2, Humanity's Last Exam, 𝜏³-Banking, AA-LCR · Higher is better
Incorporates 4 evaluations: AA-Omniscience, GDPval-AA v2, 𝜏³-Banking, AA-LCR · Higher is better
Incorporates 5 evaluations: AA-Omniscience, GDPval-AA v2, AA-LCR, 𝜏³-Banking, Humanity's Last Exam · Higher is better
Incorporates 5 evaluations: AA-Omniscience, GDPval-AA v2, MLCR-AA, Humanity's Last Exam, 𝜏³-Banking · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, GPQA Diamond, CritPt, GDPval-AA v2, Terminal-Bench v2.1 · Higher is better
Incorporates 4 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2, AA-LCR · Higher is better
Further details
Weights | Provider Benchmarks | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 12B (Reasoning) | 22 | 12B | 256k | $0.1 | 105 | ||||
| Qwen3.5 4B (Reasoning) | 20 | 4.7B | 262k | $0.0 | 27 | ||||
| Qwen3.5 4B (Non-reasoning) | 16 | 4.7B | 262k | $0.0 | 24 | ||||
| Gemma 4 12B (Non-reasoning) | 13 | 12B | 262k | $0.1 | 105 |