Gemma 4 31B vs Hermes 4 - Llama-3.1 70B: Release Comparison
Comparison of the Gemma 4 31B and Hermes 4 - Llama-3.1 70B releases: 2 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 4 models.
- For intelligence, Gemma 4 31B scores highest: Gemma 4 31B (Reasoning) at 15, against Hermes 4 - Llama-3.1 70B (Reasoning) at 8 for Hermes 4 - Llama-3.1 70B.
Releases compared
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Intelligence Index Task
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indices
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2, AA-Briefcase, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2, AA-Briefcase, Terminal-Bench v4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2, AA-Briefcase, AA-LCR v1.1 · Higher is better
Further details
Weights | Provider Benchmarks | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B (Reasoning) | 15 | 30.7B | 256k | - | 35 | +11 | |||
| Gemma 4 31B (Non-reasoning) | 14 | 30.7B | 256k | $0.2 | 52 | +8 | |||
| Hermes 4 - Llama-3.1 70B (Reasoning) | 8 | 70.6B | 128k | - | - | - | |||
| Hermes 4 - Llama-3.1 70B (Non-reasoning) | 7 | 70.6B | 128k | - | - | - |