Gemini 3.8 Flash vs Hermes 4 - Llama-3.1 405B: Release Comparison
Comparison of the Gemini 3.8 Flash and Hermes 4 - Llama-3.1 405B releases: 3 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 5 models.
- For intelligence, Gemini 3.8 Flash scores highest: Gemini 3.8 Flash (high) at 41, against Hermes 4 - Llama-3.1 405B (Reasoning) at 7 for Hermes 4 - Llama-3.1 405B.
- For output speed, Gemini 3.8 Flash is fastest: Gemini 3.8 Flash (high) at 297 t/s, against Hermes 4 - Llama-3.1 405B (Non-reasoning) at 41 t/s for Hermes 4 - Llama-3.1 405B.
Releases compared
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Intelligence Index Task
Cost per Task (USD, Log Scale)
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indexes
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better
Further details
Input modality | Output modality | Weights | Provider Benchmarks | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemini 3.8 Flash (high) |  Google | 41 | 47 | 48 | 52 | 42 | 43 | 52 | $1.24 | $0.6 | $0.75 | $3.75 | $0.075 | $1,623 | 71k | 43k | 172M | 297 | 14.26s | 14.26s | 15.94s | 229.94s | - | 1M | Sep 2026 | - | Yes | Supports: text, image, speech, and video | Supports: text | Not available | - | | |
| Gemini 3.8 Flash (medium) | Google | 40 | 45 | 48 | 51 | - | 40 | 50 | $0.93 | $0.6 | $0.75 | $3.75 | $0.075 | $1,100 | 53k | 27k | 95M | - | - | - | - | - | - | 1M | Sep 2026 | - | Yes | Supports: text, image, speech, and video | Supports: text | Not available | - | | |
| Gemini 3.8 Flash (low) | Google | 33 | 39 | 39 | 45 | - | 34 | 46 | - | $0.6 | $0.75 | $3.75 | $0.075 | - | - | - | - | - | - | - | - | - | - | 1M | Sep 2026 | - | Yes | Supports: text, image, speech, and video | Supports: text | Not available | - | | |
| Hermes 4 - Llama-3.1 405B (Reasoning) |  Nous Research | 7 | - | - | - | - | - | - | - | $1.2 | $1.00 | $3.00 | - | - | - | - | - | 40 | 2.44s | 52.37s | 64.86s | - | 406B | 128k | Aug 2025 | - | Yes | Supports: text | Supports: text |  | |||
| Hermes 4 - Llama-3.1 405B (Non-reasoning) | Nous Research | 7 | - | - | - | - | - | - | - | $1.2 | $1.00 | $3.00 | - | - | - | - | - | 41 | 2.37s | 2.37s | 14.52s | - | 406B | 128k | Aug 2025 | - | No | Supports: text | Supports: text | | |||