Gemma 4 31B

Open weights model

Released April 2026

Gemma 4 31B (Reasoning) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Gemma 4 31B (Reasoning) for your use-case.

Fastest

#1
CerebrasCerebras
1,388.6 t/s
#2
SambaNovaSambaNova
198.4 t/s
#3
Modular (NVFP4)Modular (NVFP4)
175.2 t/s
#4
FriendliAIFriendliAI
103.9 t/s
#5
CoreWeaveCoreWeave
56.0 t/s

Output speed

Total 14 providers

Lowest Latency

#1
CerebrasCerebras
1.70 s
#2
Modular (NVFP4)Modular (NVFP4)
10.38 s
#3
SambaNovaSambaNova
11.28 s
#4
FriendliAIFriendliAI
18.40 s
#5
CoreWeaveCoreWeave
33.05 s

Time to first answer token

Total 14 providers

Lowest Price

#1
Google (AI Studio)Google (AI Studio)
$0.00
#2
DeepInfraDeepInfra
$0.08
#3
ParasailParasail
$0.11
#4
CoreWeaveCoreWeave
$0.12
#5
SiliconFlow (FP8)SiliconFlow (FP8)
$0.16

Blended price (per 1M tokens)

Total 14 providers

Gemma 4 31B is available through 14 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are Cerebras (1,388.6 t/s), SambaNova (198.4 t/s), and Modular (NVFP4) (175.2 t/s). Speed varies significantly across providers, with a 7515% difference between the fastest and slowest.
  • For latency, Cerebras (1.70s), Modular (NVFP4) (10.38s), and SambaNova (11.28s) offer the lowest time to first answer token.
  • For pricing, Google (AI Studio) (0.00), DeepInfra (0.08), and Parasail (0.11) offer the lowest blended prices per 1M tokens.
  • Cerebras offers the best performance with both the highest speed and lowest latency. For cost optimization, Google (AI Studio) provides the most competitive pricing.

Highlights

Output tokens per second · Higher is better
Seconds · Lower is better
USD per 1M tokens (blended) · Lower is better

Update: Default performance benchmarking workload has updated to 10k input tokens to better reflect production use cases. You can still select different workloads above.

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Pricing: Cache Discount

1 - (cache hit price / input price) · Higher is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Measured by Output Speed (tokens per second)

Output Speed: Gemma 4 31B (Reasoning)

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant

Latency

Measured by Time (seconds) to First Token

Time to First Answer Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

CoreWeave logoCoreWeave
262k
Open
$0.07
56
2.02
41.98
31.03
Modular logoModular
262k
Open
--
175
0.47
13.23
9.91
GMI logoGMI
262k
Open
$0.10
--
--
--
--
Novita logoNovita
262k
Open
$0.10
--
--
--
--
Cerebras logoCerebras
131k
Open
$0.71
1,389
0.45
2.06
1.25
Google logoGoogle
262k
Open
$0.00
35
1.11
64.50
49.22
Parasail logoParasail
262k
Open
$0.05
24
1.43
94.93
72.59
DeepInfra logoDeepInfra
262k
Open
$0.02
25
1.49
90.68
69.24
Crusoe logoCrusoe
262k
Open
$0.10
26
1.44
86.53
66.06
SiliconFlow logoSiliconFlow
262k
Open
$0.10
44
3.88
55.27
39.90
SambaNova logoSambaNova
131k
Open
$0.28
198
2.53
13.80
8.75
FriendliAI logoFriendliAI
256k
Open
$0.10
104
1.70
23.21
16.70
Lightning AI logoLightning AI
131k
Open
$0.10
--
--
--
--
Together AI logoTogether AI
262k
Open
$0.29
18
1.38
124.00
95.20

Frequently Asked Questions

Common questions about Gemma 4 31B (Reasoning) providers