All Releases

Nova 2.0 Pro Preview vs Hermes 4 - Llama-3.1 405B: Release Comparison

Comparison of the Nova 2.0 Pro Preview and Hermes 4 - Llama-3.1 405B releases: 3 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 5 models.

  • For output speed, Nova 2.0 Pro Preview is fastest: Nova 2.0 Pro Preview (Medium) at 127 t/s, against Hermes 4 - Llama-3.1 405B (Non-reasoning) at 42 t/s for Hermes 4 - Llama-3.1 405B.
Model Playground

Releases compared

Nova 2.0 Pro Preview (medium)Nova 2.0 Pro Preview (low)Nova 2.0 Pro Preview (non-reasoning)Hermes 4 405BHermes 4 405B (non-reasoning)
Intelligence Index
--
--
--
--
--
Finance & Accounting
--
--
--
--
--
Strategy & Ops
--
--
--
--
--
Legal
--
--
--
--
--
Healthcare & Medical
--
--
--
--
--
Cost per TaskUSD
--
--
--
--
--
Output SpeedTokens/s
127
126
126
41
42
Time to First Tokens
13.86
9.93
1.09
2.36
2.30
Context Window
256k
256k
256k
128k
128k
Creator
Amazon
Amazon
Amazon
Nous Research
Nous Research
License
Proprietary
Proprietary
Proprietary
Open
Open
Input Modality

Supports: text and image

Supports: text and image

Supports: text and image

Supports: text

Supports: text

Output Modality

Supports: text

Supports: text

Supports: text

Supports: text

Supports: text

Providers
Amazon Bedrock
Amazon Bedrock
Amazon Bedrock
Nebius
Nebius
Updated

Intelligence

Artificial Analysis Intelligence Index · Higher is better
No data available

Speed

Output tokens per second · Higher is better

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better
No data available

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1
No publicly available API

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line
AA-Briefcase v1.1
AutomationBench-AA

Cost per Task (USD, Log Scale)

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No publicly available API

Speed & Latency

Output Speed

Output tokens per second · Higher is better
No publicly available API

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better

Engineering Index

Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode 2.0, AA-Briefcase v1.1 · Higher is better

Economics Index

Incorporates 4 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, GDP.pdf · Higher is better