All Releases

Gemini 4 Carbon vs Hermes 4 - Llama-3.1 70B: Release Comparison

Comparison of the Gemini 4 Carbon and Hermes 4 - Llama-3.1 70B releases: 2 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 4 models.

Model Playground

Releases compared

Gemini 4 Carbon (high)Gemini 4 Carbon (medium)Hermes 4 70BHermes 4 70B (non-reasoning)
Intelligence Index
59
58
--
--
Finance & Accounting
63
60
--
--
Strategy & Ops
61
58
--
--
Legal
62
59
--
--
Healthcare & Medical
--
--
--
--
Cost per TaskUSD
$7.76
$6.59
--
--
Output SpeedTokens/s
95
--
--
--
Time to First Tokens
137.57
--
--
--
Context Window
1M
1M
128k
128k
Creator
Google
Google
Nous Research
Nous Research
License
Proprietary
Proprietary
Open
Open
Input Modality

Supports: text, image, speech, and video

Supports: text, image, speech, and video

Supports: text

Supports: text

Output Modality

Supports: text

Supports: text

Supports: text

Supports: text

Providers
Google
Google
--
--
Updated

Intelligence

Artificial Analysis Intelligence Index · Higher is better
No publicly available API

Speed

Output tokens per second · Higher is better
No publicly available API

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better
No publicly available API

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1
No publicly available API

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Gemini 4 Carbon
Pareto line
AA-Briefcase v1.1
AutomationBench-AA

Cost per Task (USD, Log Scale)

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No publicly available API

Speed & Latency

Output Speed

Output tokens per second · Higher is better
No publicly available API

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better

Engineering Index

Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode 2.0, AA-Briefcase v1.1 · Higher is better

Economics Index

Incorporates 4 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, GDP.pdf · Higher is better