Comparisons of Medium Open Source AI Models (40B-150B)

Open source AI models with between 40 to 150 billion parameters. Models are considered Open Source (also commonly referred to as open weights) where their weights are accessible to download. This allows self-hosting on your own infrastructure and enables customizing the model such as through fine-tuning. Click on any model to see detailed metrics. For more details including relating to our methodology, see our FAQs.

NVIDIA logoLlama 3.3 Nemotron Super 49B Reasoning and DeepSeek logoDeepSeek R1 Distill Llama 70B are the highest intelligence Medium open source models, defined as those with 40B-150B parameters, followed by Meta logoLlama 4 Scout & Meta logoLlama 3.3 70B.

Highlights

Intelligence
Artificial Analysis Intelligence Index; Higher is better
Total Parameters
Trainable parameters in billions
Further details
WeightsProvider
Benchmarks
NVIDIA logo
Llama 3.3 Nemotron Super 49B v1 (Reasoning)
NVIDIA
51
49B
128k
-
-
🤗
-
View
DeepSeek logo
DeepSeek R1 Distill Llama 70B
DeepSeek
48
70B
128k
$0.8
65
🤗
Groq
Together.ai
Novita
+6 more
View
Meta logo
Llama 4 Scout
Meta
43
109B
(17B active at inference time)
10.0M
$0.3
122
🤗
Groq
Cerebras
Together.ai
+12 more
View
Meta logo
Llama 3.3 Instruct 70B
Meta
41
70B
128k
$0.6
110
🤗
Fireworks
Groq
Lambda
+19 more
View
Alibaba logo
Qwen2.5 Instruct 72B
Alibaba
40
72B
131k
-
58
🤗
Nebius
Fireworks
Nebius
+4 more
View
Cohere logo
Command A
Cohere
40
111B
256k
$4.4
167
🤗
Cohere
View
NVIDIA logo
Llama 3.3 Nemotron Super 49B v1
NVIDIA
39
49B
128k
-
-
🤗
-
View
Mistral logo
Mistral Large 2 (Nov '24)
Mistral
38
123B
128k
$3.0
87
🤗
Microsoft Azure
Mistral
View
Mistral logo
Pixtral Large
Mistral
37
124B
128k
$3.0
91
🤗
Mistral
View
NVIDIA logo
Llama 3.1 Nemotron Instruct 70B
NVIDIA
37
70B
128k
$0.2
41
🤗
Deepinfra
Lambda
View
Mistral logo
Mistral Large 2 (Jul '24)
Mistral
37
123B
128k
$3.0
105
🤗
Mistral
Amazon Bedrock
View
Meta logo
Llama 3.1 Instruct 70B
Meta
35
70B
128k
$0.8
64
🤗
Simplismart
Fireworks
Amazon Bedrock
+10 more
View
Meta logo
Llama 3.2 Instruct 90B (Vision)
Meta
33
90B
128k
$0.5
38
🤗
Deepinfra
Google
Amazon Bedrock
View
Alibaba logo
Qwen2 Instruct 72B
Alibaba
33
72B
131k
-
31
🤗
Together.ai
Alibaba Cloud
View
Nous Research logo
Hermes 3 - Llama-3.1 70B
Nous Research
29
70.6B
128k
-
-
🤗
-
View
Meta logo
Llama 3 Instruct 70B
Meta
27
70B
8.19k
$0.8
47
🤗
Together.ai
Microsoft Azure
Hyperbolic
+7 more
View
Mistral logo
Mixtral 8x22B Instruct
Mistral
26
141B
(39B active at inference time)
65.4k
$3.0
55
🤗
Mistral
Fireworks
View
Alibaba logo
Qwen1.5 Chat 110B
Alibaba
25
110B
32.0k
-
24
🤗
Alibaba Cloud
View
Alibaba logo
Qwen Chat 72B
Alibaba
22
72B
33.8k
$1.0
-
🤗
Alibaba Cloud
View
Cohere logo
Command-R+ (Aug '24)
Cohere
21
104B
128k
$4.4
51
🤗
Amazon Bedrock
Cohere
View
Meta logo
Llama 2 Chat 70B
Meta
20
70B
4.10k
-
-
🤗
-
View
Cohere logo
Command-R+ (Apr '24)
Cohere
20
104B
128k
$6.0
60
🤗
Cohere
Amazon Bedrock
Microsoft Azure
View
Databricks logo
DBRX Instruct
Databricks
20
132B
(36B active at inference time)
32.8k
-
-
🤗
-
View
AI21 Labs logo
Jamba 1.5 Mini
AI21 Labs
18
52B
(12B active at inference time)
256k
$0.3
-
🤗
Microsoft Azure
View
AI21 Labs logo
Jamba 1.6 Mini
AI21 Labs
18
52B
(12B active at inference time)
256k
$0.3
187
🤗
AI21 Labs
View
Mistral logo
Mixtral 8x7B Instruct
Mistral
17
46.7B
(12.9B active at inference time)
32.8k
$0.7
84
🤗
Amazon Bedrock
Mistral
Deepinfra
+2 more
View