All Releases

Gemma 4 E4B vs Hermes 4 - Llama-3.1 405B: Release Comparison

Comparison of the Gemma 4 E4B and Hermes 4 - Llama-3.1 405B releases: 2 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 4 models.

  • For intelligence, Gemma 4 E4B scores highest: Gemma 4 E4B (Reasoning) at 9, against Hermes 4 - Llama-3.1 405B (Reasoning) at 7 for Hermes 4 - Llama-3.1 405B.
  • For output speed, Gemma 4 E4B and Hermes 4 - Llama-3.1 405B tie at 40 t/s (Gemma 4 E4B (Reasoning) and Hermes 4 - Llama-3.1 405B (Reasoning)).
Model Playground

Releases compared

Gemma 4 E4BHermes 4 405BGemma 4 E4B (non-reasoning)Hermes 4 405B (non-reasoning)
Intelligence Index
9*
7*
7*
7*
Finance & Accounting
8
--
--
--
Strategy & Ops
3
--
--
--
Legal
11
--
--
--
Healthcare & Medical
--
--
--
--
Cost per TaskUSD
--
--
--
--
Output SpeedTokens/s
40
40
33
37
Time to First Tokens
0.94
2.36
0.95
2.33
Context Window
128k
128k
128k
128k
Creator
Google
Nous Research
Google
Nous Research
License
Open
Open
Open
Open
Input Modality

Supports: text, image, speech, and video

Supports: text

Supports: text, image, speech, and video

Supports: text

Output Modality

Supports: text

Supports: text

Supports: text

Supports: text

Providers
DeepInfra
Nebius
DeepInfra
Nebius

* Estimated

Intelligence

Artificial Analysis Intelligence Index · Higher is better

Speed

Output tokens per second · Higher is better

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better
No data available

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Intelligence Index Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line
AA-Briefcase v1.1
GDPval-AA v2.1

Cost per Task (USD, Log Scale)

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better

Speed & Latency

Output Speed

Output tokens per second · Higher is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better