Open weights model

Released October 2025

NVIDIA Nemotron Nano 12B v2 VL (Reasoning) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of NVIDIA Nemotron Nano 12B v2 VL (Reasoning) for your use-case.

Fastest

#1
DeepInfra (FP8)DeepInfra (FP8)
92.2 t/s

Output speed

Total 1 provider

Lowest Latency

#1
DeepInfra (FP8)DeepInfra (FP8)
26.02 s

Time to first answer token

Total 1 provider

Lowest Price

#1
DeepInfra (FP8)DeepInfra (FP8)
$0.24

Blended price (per 1M tokens)

Total 1 provider

NVIDIA Nemotron Nano 12B v2 VL is available through DeepInfra (FP8).

Highlights

Output tokens per second · Higher is better
Seconds · Lower is better
USD per 1M tokens (blended) · Lower is better

Update: Default performance benchmarking workload has updated to 10k input tokens to better reflect production use cases. You can still select different workloads above.

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant

Speed

Measured by Output Speed (tokens per second)

Output Speed: NVIDIA Nemotron Nano 12B v2 VL (Reasoning)

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant

Latency

Measured by Time (seconds) to First Token

Time to First Answer Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

DeepInfra logoDeepInfra
131k
Open
--
51
5.75
55.01
39.41

Frequently Asked Questions

Common questions about NVIDIA Nemotron Nano 12B v2 VL (Reasoning) providers