This model is deprecated. We only continue performance benchmarking for the default 10k input token workload. Results for other workloads are historical and no longer updated.

DeepSeek has launched a newer model, DeepSeek V3.1 Terminus (Non-reasoning). We suggest considering it instead.

For more information, see comparison of DeepSeek V3.1 Terminus (Non-reasoning) to other models and API provider benchmarks for DeepSeek V3.1 Terminus (Non-reasoning).

DeepSeek V3.1

Open weights model

Released August 2025

DeepSeek V3.1 (Non-reasoning) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of DeepSeek V3.1 (Non-reasoning) for your use-case.

Fastest

#1
SambaNovaSambaNova
184.4 t/s
#2
AmazonAmazon
126.8 t/s
#3
CoreWeaveCoreWeave
66.1 t/s
#4
NovitaNovita
36.2 t/s
#5
DeepInfra (FP4)DeepInfra (FP4)
14.1 t/s

Output speed

Total 8 providers

Lowest Latency

#1
DeepInfra (FP4)DeepInfra (FP4)
0.86 s
#2
CoreWeaveCoreWeave
1.39 s
#3
AmazonAmazon
1.45 s
#4
NovitaNovita
3.25 s
#5
SambaNovaSambaNova
3.97 s

Time to first token

Total 8 providers

Lowest Price

#1
DeepInfra (FP4)DeepInfra (FP4)
$0.24
#2
NovitaNovita
$0.34
#3
CoreWeaveCoreWeave
$0.66
#4
FireworksFireworks
$0.67
#5
AmazonAmazon
$0.69

Blended price (per 1M tokens)

Total 8 providers

DeepSeek V3.1 (Non-reasoning) is available through 8 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are SambaNova (184.4 t/s), Amazon (126.8 t/s), and CoreWeave (66.1 t/s). Speed varies significantly across providers, with a 1203% difference between the fastest and slowest.
  • For latency, DeepInfra (FP4) (0.86s), CoreWeave (1.39s), and Amazon (1.45s) offer the lowest time to first token.
  • For pricing, DeepInfra (FP4) (0.24), Novita (0.34), and CoreWeave (0.66) offer the lowest blended prices per 1M tokens. Prices vary up to 13.3x across providers.
  • DeepInfra (FP4) offers both the lowest latency and best pricing, making it attractive for cost-conscious applications. SambaNova is the fastest option for throughput-intensive workloads.

Highlights

Output tokens per second · Higher is better
Seconds · Lower is better
USD per 1M tokens (blended) · Lower is better

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Pricing: Cache Discount

1 - (cache hit price / input price) · Higher is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Measured by Output Speed (tokens per second)

Output Speed: DeepSeek V3.1 (Non-reasoning)

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant
Pareto line

Latency

Measured by Time (seconds) to First Token

Time to First Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

Google logoGoogle
164k
Open
--
--
--
--
--
Amazon Bedrock logoAmazon Bedrock
128k
Open
--
104
1.55
6.37
--
CoreWeave logoCoreWeave
128k
Open
--
62
1.44
9.57
--
Novita logoNovita
164k
Open
--
36
3.34
17.15
--
Together AI logoTogether AI
131k
Open
--
--
--
--
--
Fireworks logoFireworks
164k
Open
--
--
--
--
--
DeepInfra logoDeepInfra
164k
Open
--
15
0.87
33.92
--
SambaNova logoSambaNova
131k
Open
--
182
3.44
6.20
--

Frequently Asked Questions

Common questions about DeepSeek V3.1 (Non-reasoning) providers