Menu

logo
Artificial Analysis
HOME
logo

Google: Models Intelligence, Performance & Price

Analysis of Google's models across key metrics including quality, price, output speed, latency, context window & more. This analysis is intended to support you in choosing the best model provided by Google for your use-case. For more details including relating to our methodology, see our FAQs. Models analyzed: Llama 3.1 405B Vertex, Llama 3.2 90B (Vision) Vertex, Llama 4 Maverick Vertex, Llama 4 Scout Vertex, Gemini 2.0 Pro Experimental (AI Studio), Gemini 2.0 Flash Vertex, Gemini 2.0 Flash (AI Studio), Gemini 2.5 Pro, Gemini 2.5 Flash (AI_Studio), Gemini 2.5 Flash (Reasoning) (AI_Studio), Gemini 2.0 Flash-Lite (Feb '25) (AI Studio), Claude 3.5 Haiku Vertex, Codestral (Jan '25) Vertex, Mistral Small 3.1 Vertex, Llama 3.1 70B Vertex, Llama 3.1 8B Vertex, Gemini 2.0 Flash (exp) (AI Studio), Gemini 1.5 Pro (Sep) (Vertex), Gemini 1.5 Pro (Sep) (AI Studio), Gemini 2.0 Flash-Lite (Preview) (AI Studio), Gemini 1.5 Flash (Sep) (Vertex), Gemini 1.5 Flash (Sep) (AI Studio), Gemini 1.5 Pro (May) (Vertex), Gemini 1.5 Pro (May) (AI Studio), Gemini 1.5 Flash-8B AI Studio, Gemini 1.5 Flash (May) (Vertex), Gemini 1.5 Flash (May) (AI Studio), Claude 3.5 Sonnet (Oct) Vertex, Claude 3.5 Sonnet (June) Vertex, and Claude 3 Opus Vertex.
Link:

Google Model Comparison Summary

Intelligence:Gemini 2.5 Pro logo Gemini 2.5 Pro and Gemini 2.5 Flash (Reasoning) (AI_Studio) logo Gemini 2.5 Flash (Reasoning) (AI_Studio) are the highest quality models offered by Google, followed by Llama 4 Maverick Vertex logo Llama 4 Maverick Vertex, Gemini 2.0 Pro Experimental (AI Studio) logo Gemini 2.0 Pro Experimental (AI Studio) & Gemini 2.5 Flash (AI_Studio) logo Gemini 2.5 Flash (AI_Studio).Output Speed (tokens/s):Gemini 2.5 Flash (Reasoning) (AI_Studio) logo Gemini 2.5 Flash (Reasoning) (AI_Studio) (330 t/s) and Gemini 1.5 Flash (May) (AI Studio) logo Gemini 1.5 Flash (May) (AI Studio) (323 t/s) are the fastest models offered by Google, followed by Gemini 1.5 Flash (May) (Vertex) logo Gemini 1.5 Flash (May) (Vertex), Gemini 1.5 Flash-8B AI Studio logo Gemini 1.5 Flash-8B AI Studio & Gemini 2.5 Flash (AI_Studio) logo Gemini 2.5 Flash (AI_Studio).Latency (seconds):Codestral (Jan '25) Vertex logo Codestral (Jan '25) Vertex (0.15s) and  Llama 3.1 8B Vertex logo Llama 3.1 8B Vertex (0.17s) are the lowest latency models offered by Google, followed by Mistral Small 3.1 Vertex logo Mistral Small 3.1 Vertex, Gemini 1.5 Flash-8B AI Studio logo Gemini 1.5 Flash-8B AI Studio & Gemini 1.5 Flash (Sep) (Vertex) logo Gemini 1.5 Flash (Sep) (Vertex).Blended Price ($/M tokens):Llama 3.2 90B (Vision) Vertex logo Llama 3.2 90B (Vision) Vertex ($0.00) and Llama 4 Maverick Vertex logo Llama 4 Maverick Vertex ($0.00) are the cheapest models offered by Google, followed by Llama 4 Scout Vertex logo Llama 4 Scout Vertex, Gemini 2.0 Pro Experimental (AI Studio) logo Gemini 2.0 Pro Experimental (AI Studio) & Llama 3.1 70B Vertex logo Llama 3.1 70B Vertex.Context Window Size:Gemini 2.0 Pro Experimental (AI Studio) logo Gemini 2.0 Pro Experimental (AI Studio) (2m) and Gemini 1.5 Pro (Sep) (Vertex) logo Gemini 1.5 Pro (Sep) (Vertex) (2m) are the largest context window models offered by Google, followed by Gemini 1.5 Pro (Sep) (AI Studio) logo Gemini 1.5 Pro (Sep) (AI Studio), Gemini 1.5 Pro (May) (Vertex) logo Gemini 1.5 Pro (May) (Vertex) & Gemini 1.5 Pro (May) (AI Studio) logo Gemini 1.5 Pro (May) (AI Studio).

Highlights

Intelligence
Artificial Analysis Intelligence Index; Higher is better
Speed
Output Tokens per Second; Higher is better
Price
USD per 1M Tokens; Lower is better
Parallel Queries:
Prompt Length:
Features
Model Intelligence
Price
Output tokens/s
Latency
End-to-End Response Time
Further
Analysis
Google logo
Google logo
Gemini 2.5 Pro
1m
69
$3.44
148.8
37.95
41.31
N/A
Google (AI_Studio) logo
Google logo
Gemini 2.5 Flash (Reasoning) (AI_Studio)
1m
60
$0.99
329.8
8.93
10.45
N/A
Google Vertex logo
Meta logo
Llama 4 Maverick Vertex
524k
51
$0.00
122.8
0.33
4.41
N/A
Google (AI Studio) logo
Google logo
Gemini 2.0 Pro Experimental (AI Studio)
2m
49
$0.00
26.8
17.12
35.76
N/A
Google (AI_Studio) logo
Google logo
Gemini 2.5 Flash (AI_Studio)
1m
49
$0.26
279.3
0.40
2.19
N/A
Google Vertex logo
Google logo
Gemini 2.0 Flash Vertex
1m
48
$0.26
233.2
0.26
2.40
N/A
Google (AI Studio) logo
Google logo
Gemini 2.0 Flash (AI Studio)
1m
48
$0.17
243.9
0.40
2.45
N/A
Google (AI Studio) logo
Google logo
Gemini 2.0 Flash (exp) (AI Studio)
1m
46
$0.00
243.8
0.26
2.31
N/A
Google (Vertex) logo
Google logo
Gemini 1.5 Pro (Sep) (Vertex)
2m
45
$2.19
92.4
0.41
5.83
N/A
Google (AI Studio) logo
Google logo
Gemini 1.5 Pro (Sep) (AI Studio)
2m
45
$2.19
93.2
0.45
5.81
N/A
Google Vertex logo
Anthropic logo
Claude 3.5 Sonnet (Oct) Vertex
200k
44
$6.00
78.8
0.82
7.16
N/A
Google Vertex logo
Meta logo
Llama 4 Scout Vertex
1m
43
$0.00
129.7
0.36
4.21
N/A
Google (AI Studio) logo
Google logo
Gemini 2.0 Flash-Lite (Feb '25) (AI Studio)
1m
41
$0.13
207.1
0.28
2.69
N/A
Google Vertex logo
Meta logo
Llama 3.1 405B Vertex
128k
40
$7.75
29.4
0.41
17.43
N/A
Google (Vertex) logo
Google logo
Gemini 1.5 Flash (Sep) (Vertex)
1m
39
$0.13
194.0
0.19
2.77
N/A
Google (AI Studio) logo
Google logo
Gemini 1.5 Flash (Sep) (AI Studio)
1m
39
$0.13
198.3
0.29
2.82
N/A
Google Vertex logo
Meta logo
Llama 3.1 70B Vertex
128k
35
$0.00
72.6
0.28
7.17
N/A
Google Vertex logo
Mistral logo
Mistral Small 3.1 Vertex
128k
35
$0.15
209.5
0.17
2.56
N/A
Google Vertex logo
Anthropic logo
Claude 3 Opus Vertex
200k
35
$30.00
22.3
2.35
24.76
N/A
Google Vertex logo
Anthropic logo
Claude 3.5 Haiku Vertex
200k
35
$1.60
66.5
1.86
9.39
N/A
Google (Vertex) logo
Google logo
Gemini 1.5 Pro (May) (Vertex)
2m
34
$2.19
67.5
0.35
7.77
N/A
Google (AI Studio) logo
Google logo
Gemini 1.5 Pro (May) (AI Studio)
2m
34
$2.19
67.3
0.42
7.85
N/A
Google Vertex logo
Meta logo
Llama 3.2 90B (Vision) Vertex
128k
33
$0.00
33.2
0.20
15.24
N/A
Google AI Studio logo
Google logo
Gemini 1.5 Flash-8B AI Studio
1m
31
$0.07
288.4
0.19
1.92
N/A
Google (Vertex) logo
Google logo
Gemini 1.5 Flash (May) (Vertex)
1m
28
$0.13
321.2
0.26
1.82
N/A
Google (AI Studio) logo
Google logo
Gemini 1.5 Flash (May) (AI Studio)
1m
28
$0.13
323.4
0.25
1.79
N/A
Google Vertex logo
Mistral logo
Codestral (Jan '25) Vertex
128k
28
$0.45
150.3
0.15
3.48
N/A
Google Vertex logo
Meta logo
Llama 3.1 8B Vertex
128k
24
$0.00
119.9
0.17
4.34
N/A
Google (AI Studio) logo
Google logo
Gemini 2.0 Flash-Lite (Preview) (AI Studio)
1m
$0.13
205.0
0.28
2.72
N/A
Google Vertex logo
Anthropic logo
Claude 3.5 Sonnet (June) Vertex
200k
$6.00
79.7
0.85
7.12
N/A

Key definitions

Context window: Maximum number of combined input & output tokens. Output tokens commonly have a significantly lower limit (varied by model).
Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).
Latency (Time to First Token): Time to first token received, in seconds, after API request sent. For reasoning models which share reasoning tokens, this will be the first reasoning token. For models which do not support streaming, this represents time to receive the completion.
Price: Price per token, represented as USD per million Tokens. Price is a blend of Input & Output token prices (3:1 ratio).
Output Price: Price per token generated by the model (received from the API), represented as USD per million Tokens.
Input Price: Price per token included in the request/message sent to the API, represented as USD per million Tokens.
Time period: Metrics are 'live' and are based on the past 72 hours of measurements, measurements are taken 8 times a day for single requests and 2 times per day for parallel requests.