This model is deprecated. We only continue performance benchmarking for the default 10k input token workload. Results for other workloads are historical and no longer updated.

Google has launched a newer model, Gemma 4 31B. We suggest considering it instead.

For more information, see comparison of Gemma 4 31B to other models and API provider benchmarks for Gemma 4 31B.

•

Open weights model

•

Released March 2025

Gemma 3 27B Instruct API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Gemma 3 27B Instruct for your use-case.

Fastest

#1
AmazonAmazon
68.5 t/s
#2
Nebius (FP8)Nebius (FP8)
64.5 t/s
#3
ParasailParasail
45.4 t/s
#4
NovitaNovita
34.3 t/s
#5
DeepInfraDeepInfra
16.6 t/s

Output speed

Total 6 providers

Lowest Latency

#1
AmazonAmazon
1.45 s
#2
NovitaNovita
1.58 s
#3
DeepInfraDeepInfra
1.63 s
#4
ParasailParasail
1.95 s
#5
Nebius (FP8)Nebius (FP8)
2.86 s

Time to first token

Total 6 providers

Lowest Price

#1
Google (AI Studio)Google (AI Studio)
$0.00
#2
DeepInfraDeepInfra
$0.09
#3
ParasailParasail
$0.09
#4
Nebius (FP8)Nebius (FP8)
$0.12
#5
NovitaNovita
$0.13

Blended price (per 1M tokens)

Total 6 providers

Gemma 3 27B is available through 6 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are Amazon (68.5 t/s), Nebius (FP8) (64.5 t/s), and Parasail (45.4 t/s). Speed varies significantly across providers, with a 314% difference between the fastest and slowest.
  • For latency, Amazon (1.45s), Novita (1.58s), and DeepInfra (1.63s) offer the lowest time to first token.
  • For pricing, Google (AI Studio) (0.00), DeepInfra (0.09), and Parasail (0.09) offer the lowest blended prices per 1M tokens.
  • Amazon offers the best performance with both the highest speed and lowest latency. For cost optimization, Google (AI Studio) provides the most competitive pricing.

Highlights

Output tokens per second · Higher is better
Seconds to first answer token received · Lower is better
USD per 1M tokens (blended) · Lower is better

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Pricing: Cache Discount

1 - (cache hit price / input price) · Higher is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Measured by Output Speed (tokens per second)

Output Speed: Gemma 3 27B Instruct

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant

Latency

Measured by Time (seconds) to First Token

Time to First Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

Amazon Bedrock logoAmazon Bedrock
128k
Open
$0.47
63
1.47
9.41
--
DeepInfra logoDeepInfra
131k
Open
$0.16
15
1.79
34.31
--
Nebius logoNebius
110k
Open
$0.20
59
3.03
11.44
--
Google logoGoogle
128k
Open
$0.00
--
--
--
--
Parasail logoParasail
131k
Open
$0.10
45
1.90
12.92
--
Novita logoNovita
98.3k
Open
$0.24
32
1.54
17.37
--

Frequently Asked Questions

Common questions about Gemma 3 27B Instruct providers