Open weights model

Released April 2025

Llama 4 Scout API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Llama 4 Scout for your use-case.

Fastest

#1
AmazonAmazon
163.1 t/s
#2
Google VertexGoogle Vertex
143.5 t/s
#3
AzureAzure
131.7 t/s
#4
NovitaNovita
24.2 t/s
#5
DeepInfraDeepInfra
23.3 t/s

Output speed

Total 6 providers

Lowest Latency

#1
Google VertexGoogle Vertex
0.74 s
#2
AmazonAmazon
0.82 s
#3
AzureAzure
0.87 s
#4
DeepInfraDeepInfra
1.06 s
#5
NovitaNovita
1.63 s

Time to first token

Total 6 providers

Lowest Price

#1
DeepInfraDeepInfra
$0.12
#2
AmazonAmazon
$0.22
#3
NovitaNovita
$0.22
#4
AzureAzure
$0.26
#5
Google VertexGoogle Vertex
$0.30

Blended price (per 1M tokens)

Total 6 providers

Llama 4 Scout is available through 6 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are Amazon (163.1 t/s), Google Vertex (143.5 t/s), and Azure (131.7 t/s). Speed varies significantly across providers, with a 599% difference between the fastest and slowest.
  • For latency, Google Vertex (0.74s), Amazon (0.82s), and Azure (0.87s) offer the lowest time to first token.
  • For pricing, DeepInfra (0.12), Amazon (0.22), and Novita (0.22) offer the lowest blended prices per 1M tokens. Prices vary up to 2.7x across providers.

Highlights

Output tokens per second · Higher is better
Seconds · Lower is better
USD per 1M tokens (blended) · Lower is better

Update: Default performance benchmarking workload has updated to 10k input tokens to better reflect production use cases. You can still select different workloads above.

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Measured by Output Speed (tokens per second)

Output Speed: Llama 4 Scout

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant
Pareto line

Latency

Measured by Time (seconds) to First Token

Time to First Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

DeepInfra logoDeepInfra
328k
Open
$0.06
22
1.06
23.70
--
Microsoft Azure logoMicrosoft Azure
128k
Open
$0.12
132
0.87
4.66
--
Google logoGoogle
1.31M
Open
$0.16
144
0.74
4.22
--
Cloudflare logoCloudflare
131k
Open
$0.17
--
--
--
--
Amazon Bedrock logoAmazon Bedrock
128k
Open
$0.11
163
0.82
3.89
--
Novita logoNovita
131k
Open
$0.11
22
1.63
24.87
--

Frequently Asked Questions

Common questions about Llama 4 Scout providers