This model is deprecated. We only continue performance benchmarking for the default 10k input token workload. Results for other workloads are historical and no longer updated.

Alibaba has launched a newer model, Qwen3 30B A3B 2507 (Non-reasoning). We suggest considering it instead.

For more information, see comparison of Qwen3 30B A3B 2507 (Non-reasoning) to other models and API provider benchmarks for Qwen3 30B A3B 2507 (Non-reasoning).

Qwen3 32B

Open weights model

Released April 2025

Qwen3 32B (Non-reasoning) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Qwen3 32B (Non-reasoning) for your use-case.

Fastest

#1
AmazonAmazon
111.9 t/s
#2
Alibaba CloudAlibaba Cloud
99.3 t/s
#3
DeepInfra (FP8)DeepInfra (FP8)
31.7 t/s

Output speed

Total 4 providers

Lowest Latency

#1
AmazonAmazon
1.10 s
#2
DeepInfra (FP8)DeepInfra (FP8)
1.54 s
#3
Alibaba CloudAlibaba Cloud
2.46 s

Time to first token

Total 4 providers

Lowest Price

#1
DeepInfra (FP8)DeepInfra (FP8)
$0.10
#2
AmazonAmazon
$0.20
#3
Alibaba CloudAlibaba Cloud
$0.21
#4
SambaNovaSambaNova
$0.44

Blended price (per 1M tokens)

Total 4 providers

Qwen3 32B (Non-reasoning) is available through 4 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are Amazon (111.9 t/s), Alibaba Cloud (99.3 t/s), and DeepInfra (FP8) (31.7 t/s).
  • For latency, Amazon (1.10s), DeepInfra (FP8) (1.54s), and Alibaba Cloud (2.46s) offer the lowest time to first token.
  • For pricing, DeepInfra (FP8) (0.10), Amazon (0.20), and Alibaba Cloud (0.21) offer the lowest blended prices per 1M tokens. Prices vary up to 4.4x across providers.
  • Amazon offers the best performance with both the highest speed and lowest latency. For cost optimization, DeepInfra (FP8) provides the most competitive pricing.

Highlights

Output tokens per second · Higher is better
Seconds · Lower is better
USD per 1M tokens (blended) · Lower is better

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Measured by Output Speed (tokens per second)

Output Speed: Qwen3 32B (Non-reasoning)

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant

Latency

Measured by Time (seconds) to First Token

Time to First Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

DeepInfra logoDeepInfra
41k
Open
--
25
1.35
21.38
--
Alibaba Cloud logoAlibaba Cloud
131k
Open
--
107
2.46
7.15
--
Amazon Bedrock logoAmazon Bedrock
32.8k
Open
--
121
1.12
5.24
--
SambaNova logoSambaNova
32.8k
Open
--
--
--
--
--

Frequently Asked Questions

Common questions about Qwen3 32B (Non-reasoning) providers