Nous Research Models: Intelligence, Performance & Price
Hermes 4 70BHermes 4 405BHermes 4 405B (non-reasoning)Hermes 4 70B (non-reasoning)DeepHermes 3 - Mistral 24B (non-reasoning)Artificial Analysis Intelligence Index
* Estimated
Artificial Analysis has benchmarked 7 models from Nous Research. Below is a comparison of the key metrics across these models.
- For intelligence, the top model from Nous Research is Hermes 4 - Llama-3.1 70B (Reasoning) at 8 (estimated).
- For output speed, the fastest model is Hermes 4 - Llama-3.1 405B (Reasoning) at 33 t/s.
- For latency, Hermes 4 - Llama-3.1 405B (Non-reasoning) at 2.28s offers the lowest time to first answer token.
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Task
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indexes
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better
All Nous Research Releases
Further details
Weights | Provider Benchmarks | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Hermes 4 - Llama-3.1 70B (Reasoning) | Nous Research | 8 | 70.6B | 128k | - | - | - | ||
| Hermes 4 - Llama-3.1 405B (Reasoning) | Nous Research | 7 | 406B | 128k | $1.2 | 33 |  | ||
| Hermes 4 - Llama-3.1 405B (Non-reasoning) | Nous Research | 7 | 406B | 128k | $1.2 | 31 | | ||
| Hermes 4 - Llama-3.1 70B (Non-reasoning) | Nous Research | 7 | 70.6B | 128k | - | - | - | ||
| DeepHermes 3 - Mistral 24B Preview (Non-reasoning) | Nous Research | 6 | 24B | 32k | - | - | - | ||
| Hermes 3 - Llama-3.1 70B | Nous Research | 6 | 70.6B | 128k | $0.7 | 28 |  | ||
| DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning) | Nous Research | 5 | 8B | 128k | - | - | - |