•

Open weights model

•

Released April 2025

Llama 4 Maverick API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Llama 4 Maverick for your use-case.

Fastest

#1
Azure (FP8)Azure (FP8)
428.0 t/s
#2
AmazonAmazon
220.4 t/s
#3
Parasail (FP8)Parasail (FP8)
74.8 t/s
#4
DeepInfra (FP8)DeepInfra (FP8)
44.5 t/s
#5
Novita (FP8)Novita (FP8)
42.7 t/s

Output speed

Total 6 providers

Lowest Latency

#1
DeepInfra (FP8)DeepInfra (FP8)
0.82 s
#2
AmazonAmazon
0.84 s
#3
Novita (FP8)Novita (FP8)
1.15 s
#4
Parasail (FP8)Parasail (FP8)
1.26 s
#5
Azure (FP8)Azure (FP8)
1.33 s

Time to first token

Total 6 providers

Lowest Price

#1
DeepInfra (FP8)DeepInfra (FP8)
$0.26
#2
Parasail (FP8)Parasail (FP8)
$0.29
#3
AmazonAmazon
$0.31
#4
Azure (FP8)Azure (FP8)
$0.33
#5
Novita (FP8)Novita (FP8)
$0.33

Blended price (per 1M tokens)

Total 6 providers

Llama 4 Maverick is available through 6 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are Azure (FP8) (428.0 t/s), Amazon (220.4 t/s), and Parasail (FP8) (74.8 t/s). Speed varies significantly across providers, with a 902% difference between the fastest and slowest.
  • For latency, DeepInfra (FP8) (0.82s), Amazon (0.84s), and Novita (FP8) (1.15s) offer the lowest time to first token.
  • For pricing, DeepInfra (FP8) (0.26), Parasail (FP8) (0.29), and Amazon (0.31) offer the lowest blended prices per 1M tokens.
  • DeepInfra (FP8) offers both the lowest latency and best pricing, making it attractive for cost-conscious applications. Azure (FP8) is the fastest option for throughput-intensive workloads.

Highlights

Output tokens per second · Higher is better
Seconds to first answer token received · Lower is better
USD per 1M tokens (blended) · Lower is better

Update: Default performance benchmarking workload has updated to 10k input tokens to better reflect production use cases. You can still select different workloads above.

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Pricing: Cache Discount

1 - (cache hit price / input price) · Higher is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Measured by Output Speed (tokens per second)

Output Speed: Llama 4 Maverick

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant
Pareto line

Latency

Measured by Time (seconds) to First Token

Time to First Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

Novita logoNovita
1.05M
Open
--
43
1.17
12.88
--
Microsoft Azure logoMicrosoft Azure
128k
Open
--
428
1.34
2.51
--
Amazon Bedrock logoAmazon Bedrock
128k
Open
--
258
0.98
2.91
--
Together AI logoTogether AI
1.05M
Open
--
--
--
--
--
DeepInfra logoDeepInfra
1.05M
Open
--
46
0.84
11.70
--
Parasail logoParasail
1.05M
Open
--
75
1.26
7.92
--

Frequently Asked Questions

Common questions about Llama 4 Maverick providers