Menu

logo
Artificial Analysis
HOME
logo

Deepinfra: Models Intelligence, Performance & Price

Analysis of Deepinfra's models across key metrics including quality, price, output speed, latency, context window & more. This analysis is intended to support you in choosing the best model provided by Deepinfra for your use-case. For more details including relating to our methodology, see our FAQs. Models analyzed: Llama 3.3 70B (Turbo, FP8), Llama 3.3 70B, Llama 3.1 405B, Llama 3.2 90B (Vision), Llama 3.2 11B (Vision), Llama 4 Maverick (FP8), Llama 4 Scout, Gemma 3 27B, Gemma 3 4B, Gemma 3 12B, Mistral NeMo, Mixtral 8x7B, DeepSeek R1 (Turbo, FP4), DeepSeek R1, DeepSeek R1 Distill Llama 70B, DeepSeek V3 (Mar' 25), DeepSeek R1 Distill Qwen 32B, Phi-4, Llama 3.1 Nemotron 70B, Qwen3 235B A22B (Reasoning) (FP8), Qwen3 14B (Reasoning) (FP8), Qwen3 32B (Reasoning) (FP8), Qwen3 30B A3B (Reasoning) (FP8), QwQ-32B, Llama 3.1 70B (Turbo, FP8), Llama 3.1 70B, Llama 3.1 8B, Llama 3.2 3B, Llama 3 70B, Llama 3 8B, Llama 3.2 1B, Gemma 2 9B, Mistral Small 3, Mistral 7B, DeepSeek V3 (Dec '24), OpenChat 3.5, Qwen2.5 72B, Qwen2.5 Coder 32B, and QwQ 32B-Preview.
Link:

Deepinfra Model Comparison Summary

Intelligence:Qwen3 235B A22B (Reasoning) (FP8) logo Qwen3 235B A22B (Reasoning) (FP8) and DeepSeek R1 (Turbo, FP4) logo DeepSeek R1 (Turbo, FP4) are the highest quality models offered by Deepinfra, followed by DeepSeek R1 logo DeepSeek R1, Qwen3 32B (Reasoning) (FP8) logo Qwen3 32B (Reasoning) (FP8) & QwQ-32B logo QwQ-32B.Output Speed (tokens/s):DeepSeek R1 (Turbo, FP4) logo DeepSeek R1 (Turbo, FP4) (167 t/s) and Llama 3.2 1B logo Llama 3.2 1B (130 t/s) are the fastest models offered by Deepinfra, followed by Llama 3 8B logo Llama 3 8B, Llama 3.2 3B logo Llama 3.2 3B & Mixtral 8x7B logo Mixtral 8x7B.Latency (seconds):Llama 3 8B logo Llama 3 8B (0.18s) and  Mistral Small 3 logo Mistral Small 3 (0.19s) are the lowest latency models offered by Deepinfra, followed by Mistral 7B logo Mistral 7B, Llama 3.2 3B logo Llama 3.2 3B & Mixtral 8x7B logo Mixtral 8x7B.Blended Price ($/M tokens):Llama 3.2 1B logo Llama 3.2 1B ($0.01) and Llama 3.2 3B logo Llama 3.2 3B ($0.02) are the cheapest models offered by Deepinfra, followed by Gemma 3 4B logo Gemma 3 4B, Llama 3.1 8B logo Llama 3.1 8B & Mistral 7B logo Mistral 7B.Context Window Size:DeepSeek V3 (Mar' 25) logo DeepSeek V3 (Mar' 25) (164k) and Llama 4 Maverick (FP8) logo Llama 4 Maverick (FP8) (131k) are the largest context window models offered by Deepinfra, followed by Llama 4 Scout logo Llama 4 Scout, QwQ-32B logo QwQ-32B & Llama 3.3 70B (Turbo, FP8) logo Llama 3.3 70B (Turbo, FP8).

Highlights

Intelligence
Artificial Analysis Intelligence Index; Higher is better
Speed
Output Tokens per Second; Higher is better
Price
USD per 1M Tokens; Lower is better
Parallel Queries:
Prompt Length:
Features
Model Intelligence
Price
Output tokens/s
Latency
End-to-End Response Time
Further
Analysis
Deepinfra (FP8) logo
Alibaba logo
Qwen3 235B A22B (Reasoning) (FP8)
41k
62
$0.30
22.0
0.59
114.07
90.79
Deepinfra (Turbo, FP4) logo
DeepSeek logo
DeepSeek R1 (Turbo, FP4)
33k
60
$1.50
166.8
0.28
17.35
14.07
Deepinfra logo
DeepSeek logo
DeepSeek R1
64k
60
$0.96
52.7
0.32
54.35
44.54
Deepinfra (FP8) logo
Alibaba logo
Qwen3 32B (Reasoning) (FP8)
41k
59
$0.15
42.1
0.27
59.62
47.48
Deepinfra logo
Alibaba logo
QwQ-32B
131k
58
$0.14
43.5
0.27
69.03
57.27
Deepinfra (FP8) logo
Alibaba logo
Qwen3 14B (Reasoning) (FP8)
128k
56
$0.12
73.1
0.55
34.73
27.34
Deepinfra (FP8) logo
Alibaba logo
Qwen3 30B A3B (Reasoning) (FP8)
41k
56
$0.15
52.2
0.22
48.08
38.29
Deepinfra logo
DeepSeek logo
DeepSeek V3 (Mar' 25)
164k
53
$0.52
19.4
0.63
26.41
N/A
Deepinfra logo
DeepSeek logo
DeepSeek R1 Distill Qwen 32B
128k
52
$0.14
47.0
0.27
53.42
42.52
Deepinfra (FP8) logo
Meta logo
Llama 4 Maverick (FP8)
131k
51
$0.30
85.1
0.37
6.24
N/A
Deepinfra logo
DeepSeek logo
DeepSeek R1 Distill Llama 70B
128k
48
$0.34
34.5
0.42
72.93
58.01
Deepinfra logo
DeepSeek logo
DeepSeek V3 (Dec '24)
64k
46
$0.59
26.4
0.39
19.36
N/A
Deepinfra logo
Meta logo
Llama 4 Scout
131k
43
$0.15
52.4
0.55
10.10
N/A
Deepinfra logo
Alibaba logo
QwQ 32B-Preview
33k
43
$0.26
44.4
0.29
56.59
45.04
Deepinfra (Turbo, FP8) logo
Meta logo
Llama 3.3 70B (Turbo, FP8)
128k
41
$0.20
34.0
0.27
14.99
N/A
Deepinfra logo
Meta logo
Llama 3.3 70B
128k
41
$0.27
27.6
0.62
18.74
N/A
Deepinfra logo
Meta logo
Llama 3.1 405B
33k
40
$0.90
24.9
0.75
20.84
N/A
Deepinfra logo
Alibaba logo
Qwen2.5 72B
33k
40
$0.27
33.9
0.57
15.34
N/A
Deepinfra logo
Microsoft Azure logo
Phi-4
16k
40
$0.09
39.0
0.30
13.13
N/A
Deepinfra logo
Google logo
Gemma 3 27B
128k
38
$0.07
35.4
0.61
14.73
N/A
Deepinfra logo
NVIDIA logo
Llama 3.1 Nemotron 70B
128k
37
$0.27
26.0
0.43
19.65
N/A
Deepinfra logo
Alibaba logo
Qwen2.5 Coder 32B
33k
36
$0.10
51.8
0.25
9.91
N/A
Deepinfra (Turbo, FP8) logo
Meta logo
Llama 3.1 70B (Turbo, FP8)
128k
35
$0.20
33.7
0.27
15.11
N/A
Deepinfra logo
Meta logo
Llama 3.1 70B
128k
35
$0.27
49.9
0.54
10.55
N/A
Deepinfra logo
Mistral logo
Mistral Small 3
32k
35
$0.09
86.5
0.19
5.97
N/A
Deepinfra logo
Google logo
Gemma 3 12B
128k
34
$0.06
21.3
0.69
24.12
N/A
Deepinfra logo
Meta logo
Llama 3.2 90B (Vision)
33k
33
$0.36
48.4
0.58
10.91
N/A
Deepinfra logo
Meta logo
Llama 3 70B
8k
27
$0.27
31.8
0.43
16.15
N/A
Deepinfra logo
Google logo
Gemma 3 4B
128k
24
$0.03
89.9
0.23
5.79
N/A
Deepinfra logo
Meta logo
Llama 3.1 8B
128k
24
$0.04
51.6
0.29
9.98
N/A
Deepinfra logo
Google logo
Gemma 2 9B
8k
22
$0.04
21.7
0.61
23.67
N/A
Deepinfra logo
Meta logo
Llama 3 8B
8k
21
$0.04
109.3
0.18
4.75
N/A
Deepinfra logo
Mistral logo
Mistral NeMo
128k
20
$0.06
61.3
0.44
8.59
N/A
Deepinfra logo
Meta logo
Llama 3.2 3B
128k
20
$0.02
109.2
0.20
4.78
N/A
Deepinfra logo
Mistral logo
Mixtral 8x7B
33k
17
$0.24
95.9
0.22
5.43
N/A
Deepinfra logo
Mistral logo
Mistral 7B
8k
10
$0.04
91.5
0.20
5.66
N/A
Deepinfra logo
Meta logo
Llama 3.2 1B
128k
10
$0.01
130.3
0.27
4.11
N/A
Deepinfra logo
Meta logo
Llama 3.2 11B (Vision)
128k
$0.06
47.8
0.36
10.81
N/A
Deepinfra logo
OpenChat logo
OpenChat 3.5
8k
$0.06
55.8
0.49
9.45
N/A

Key definitions

Context window: Maximum number of combined input & output tokens. Output tokens commonly have a significantly lower limit (varied by model).
Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).
Latency (Time to First Token): Time to first token received, in seconds, after API request sent. For reasoning models which share reasoning tokens, this will be the first reasoning token. For models which do not support streaming, this represents time to receive the completion.
Price: Price per token, represented as USD per million Tokens. Price is a blend of Input & Output token prices (3:1 ratio).
Output Price: Price per token generated by the model (received from the API), represented as USD per million Tokens.
Input Price: Price per token included in the request/message sent to the API, represented as USD per million Tokens.
Time period: Metrics are 'live' and are based on the past 72 hours of measurements, measurements are taken 8 times a day for single requests and 2 times per day for parallel requests.