••

Open weights model

•

Released August 2025

Hermes 4 - Llama-3.1 405B (Non-reasoning) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Hermes 4 - Llama-3.1 405B (Non-reasoning) for your use-case.

Lowest Time per Task

Time per Intelligence Index task (minutes)

Total 1 provider

Lowest Cost per Task

Cost per Intelligence Index task

Total 1 provider

Hermes 4 405B (non-reasoning) is available through Nebius (FP8).

Inference time (minutes) per Intelligence Index task · Lower is better
No data available
Weighted average cost (USD) per Intelligence Index task · Lower is better
No data available

Pricing

Cost per Intelligence Index Task: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No data available

Pricing: Cache Hit, Input, and Output: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Price (USD per M Tokens) · Lower is better

Output Speed vs. Cost per Task: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Output speed: output tokens divided by total request time, including time to first token · Weighted average cost (USD) per Intelligence Index task
Most attractive quadrant
No data available

Speed

Average of the single-request and multi-turn agentic workloads measured

Output Speed: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Output tokens divided by total request time · Includes time to first token · Average of the single-request and multi-turn agentic workloads measured · Higher is better

Latency

Average of the single-request and multi-turn agentic workloads measured

Time to First Answer Token: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

Reliability

Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

Endpoint Error Rate: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

Caching

Cache Hit Rate: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Median across multi-turn agentic session runs in the last four weeks, updated Oct 26, 2026 · Higher is better

Cost per Task vs. Cache Hit Rate: Hermes 4 - Llama-3.1 405B (Non-reasoning)

Weighted average cost (USD) per Intelligence Index task · Cache hit rate: median of the last four weeks, updated Oct 26, 2026
Most attractive quadrant
No data available

Key Comparison Metrics & API Features

Nebius logoNebius
--
--
5.32
13.1%
128k
Open

Frequently Asked Questions

Common questions about Hermes 4 - Llama-3.1 405B (Non-reasoning) providers