•

Open weights model

•

Released June 2026

Nemotron 3 Ultra 550B A55B (Reasoning) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Nemotron 3 Ultra 550B A55B (Reasoning) for your use-case.

Fastest

#1
CoreWeaveCoreWeave
329.8 t/s
#2
NebiusNebius
309.4 t/s
#3
DeepInfra BF16DeepInfra BF16
183.2 t/s
#4
FireworksFireworks
183.1 t/s
#5
DeepInfraDeepInfra
163.2 t/s

Output speed

Total 7 providers

Lowest Latency

#1
CoreWeaveCoreWeave
7.92 s
#2
NebiusNebius
9.61 s
#3
FireworksFireworks
13.09 s
#4
DeepInfra BF16DeepInfra BF16
13.66 s
#5
DeepInfraDeepInfra
15.06 s

Time to first answer token

Total 7 providers

Lowest Price

#1
Blackbox AIBlackbox AI
$0.37
#2
CoreWeaveCoreWeave
$0.39
#3
DeepInfraDeepInfra
$0.39
#4
FireworksFireworks
$0.44
#5
GMIGMI
$0.49

Blended price (per 1M tokens)

Total 7 providers

Nemotron 3 Ultra is available through 7 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are CoreWeave (329.8 t/s), Nebius (309.4 t/s), and DeepInfra BF16 (183.2 t/s). Speed varies significantly across providers, with a 102% difference between the fastest and slowest.
  • For latency, CoreWeave (7.92s), Nebius (9.61s), and Fireworks (13.09s) offer the lowest time to first answer token.
  • For pricing, Blackbox AI (0.37), CoreWeave (0.39), and DeepInfra (0.39) offer the lowest blended prices per 1M tokens. Prices vary up to 3.3x across providers.
  • CoreWeave offers the best performance with both the highest speed and lowest latency. For cost optimization, Blackbox AI provides the most competitive pricing.

Highlights

Output tokens per second · Higher is better
Seconds to first answer token received · Lower is better
USD per 1M tokens (blended) · Lower is better

Update: Default performance benchmarking workload has updated to 10k input tokens to better reflect production use cases. You can still select different workloads above.

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Pricing: Cache Discount

1 - (cache hit price / input price) · Higher is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant

Speed

Measured by Output Speed (tokens per second)

Output Speed: Nemotron 3 Ultra 550B A55B (Reasoning)

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant
Pareto line

Latency

Measured by Time (seconds) to First Token

Time to First Answer Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

CoreWeave logoCoreWeave
262k
Open
$0.51
330
1.02
9.43
6.90
GMI logoGMI
262k
Open
--
--
--
--
--
DeepInfra logoDeepInfra
262k
Open
$0.47
163
1.12
18.12
13.94
DeepInfra logoDeepInfra
262k
Open
$0.99
183
1.24
16.39
12.42
Nebius logoNebius
256k
Open
$1.16
309
2.26
11.23
7.35
Blackbox AI logoBlackbox AI
262k
Open
$0.37
--
--
--
--
Fireworks logoFireworks
262k
Open
$0.32
183
0.67
15.83
12.43

Frequently Asked Questions

Common questions about Nemotron 3 Ultra 550B A55B (Reasoning) providers