All Releases•

7 models

Nous Research Models: Intelligence, Performance & Price

Artificial Analysis has benchmarked 7 models from Nous Research. Below is a comparison of the key metrics across these models.

  • For intelligence, the top model from Nous Research is Hermes 4 - Llama-3.1 70B (Reasoning) at 8 (estimated).
  • For output speed, the fastest model is Hermes 4 - Llama-3.1 405B (Reasoning) at 43 t/s.
  • For latency, Hermes 4 - Llama-3.1 405B (Non-reasoning) at 2.31s offers the lowest time to first answer token.

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Intelligence Index Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
No data available

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better
No data available

Speed & Latency

Output Speed

Output tokens per second · Higher is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

No data available
Strategy & Ops Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

No data available
Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

No data available
Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

No data available
Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

No data available
Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

No data available

All Nous Research Releases

Further details

Weights
Provider Benchmarks
Hermes 4 - Llama-3.1 70B (Reasoning)
Nous Research logoNous Research
8
70.6B
128k
-
-
-
Hermes 4 - Llama-3.1 405B (Reasoning)
Nous Research logoNous Research
7
406B
128k
$1.2
43
Nebius
Hermes 4 - Llama-3.1 405B (Non-reasoning)
Nous Research logoNous Research
7
406B
128k
$1.2
43
Nebius
Hermes 4 - Llama-3.1 70B (Non-reasoning)
Nous Research logoNous Research
7
70.6B
128k
-
-
-
DeepHermes 3 - Mistral 24B Preview (Non-reasoning)
Nous Research logoNous Research
6
24B
32k
-
-
-
Hermes 3 - Llama-3.1 70B
Nous Research logoNous Research
6
70.6B
128k
$0.7
30
DeepInfra
DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning)
Nous Research logoNous Research
5
8B
128k
-
-
-