Qwen2 Instruct 72B: Intelligence, Performance & Price Analysis

Name: Intelligence Index by Qwen2 Endpoint
Creator: Artificial Analysis

Analysis of Alibaba's Qwen2 Instruct 72B and comparison to other AI models across key metrics including quality, price, performance (tokens per second & time to first token), context window & more. Click on any model to compare API providers for that model. For more details including relating to our methodology, see our FAQs.

For analysis of API providers see

Comparison Summary

Intelligence:

Qwen2 72B is of lower quality compared to average, with a MMLU score of 0.622 and a Intelligence Index across evaluations of 33.

Price:Speed:

Qwen2 72B is slower compared to average, with a output speed of 30.9 tokens per second.

Latency:

Qwen2 72B has a lower latency compared to average, taking 1.39s to receive the first token (TTFT).

Context Window:

Qwen2 72B has a smaller context windows than average, with a context window of 130k tokens.

Highlights

Intelligence

Artificial Analysis Intelligence Index; Higher is better

Speed

Output Tokens per Second; Higher is better

Price

USD per 1M Tokens; Lower is better

Navigation

Intelligence

Intelligence Index Token Use & Cost

Context Window

Pricing

Performance Summary

Speed

Latency

Time to First Answer Token

End-to-End Response Time

Comparisons

Qwen2 Instruct 72B Model Details

Creator
Context Window	131k tokens (~197 A4 pages of size 12 Arial font)
Release Date	June, 2024
Parameters	72B
Image Input Support	No
Open Source (Weights)	Yes
License	Tongyi Qianwen LICENSE AGREEMENT
License Supports Commercial Use Without Restrictions	Yes

Intelligence

Back to Navigation

Artificial Analysis Intelligence Index

Intelligence Index incorporates 7 evaluations: MMLU-Pro, GPQA Diamond, Humanity's Last Exam, LiveCodeBench, SciCode, AIME, MATH-500

+ Add model from specific provider

Artificial Analysis Intelligence Index: Combination metric covering multiple dimensions of intelligence - the simplest way to compare how smart models are. Version 2 was released in Feb '25 and includes: MMLU-Pro, GPQA Diamond, Humanity's Last Exam, LiveCodeBench, SciCode, AIME, MATH-500. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Artificial Analysis Intelligence Index by Model Type

Intelligence Index incorporates 7 evaluations: MMLU-Pro, GPQA Diamond, Humanity's Last Exam, LiveCodeBench, SciCode, AIME, MATH-500

Reasoning Model

Non-Reasoning Model

+ Add model from specific provider

Artificial Analysis Intelligence Index by Open Weights vs Proprietary

Intelligence Index incorporates 7 evaluations: MMLU-Pro, GPQA Diamond, Humanity's Last Exam, LiveCodeBench, SciCode, AIME, MATH-500

Proprietary

Open Weights (Commercial Use Restricted)

Open Weights

+ Add model from specific provider

Open Weights: Indicates whether the model weights are available. Models are labelled as 'Commercial Use Restricted' if the weights are available but commercial use is limited (typically requires obtaining a paid license).

Artificial Analysis Coding Index

Represents the average of coding benchmarks in the Artificial Analysis Intelligence Index (LiveCodeBench & SciCode)

+ Add model from specific provider

Artificial Analysis Coding Index: Represents the average of coding evaluations in the Artificial Analysis Intelligence Index. Currently includes: LiveCodeBench, SciCode. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Artificial Analysis Math Index

Represents the average of math benchmarks in the Artificial Analysis Intelligence Index (AIME 2024 & Math-500)

+ Add model from specific provider

Artificial Analysis Math Index: Represents the average of math evaluations in the Artificial Analysis Intelligence Index. Currently includes: AIME, MATH-500. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Intelligence Evaluations

Intelligence evaluations measured independently by Artificial Analysis; Higher is better

Results claimed by AI Lab (not yet independently verified)

MMLU-Pro (Reasoning & Knowledge)

GPQA Diamond (Scientific Reasoning)

Humanity's Last Exam (Reasoning & Knowledge)

LiveCodeBench (Coding)

SciCode (Coding)

HumanEval (Coding)

MATH-500 (Quantitative Reasoning)

AIME 2024 (Competition Math)

Multilingual Index (Artificial Analysis)

+ Add model from specific provider

While model intelligence generally translates across use cases, specific evaluations may be more relevant for certain use cases.

Intelligence vs. Price

Artificial Analysis Intelligence Index (Version 2, released Feb '25); Price: USD per 1M Tokens

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemini 2.5 Pro Preview

Claude 3.7 Sonnet Thinking

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3 mini Reasoning (high)

Grok 3

Nova Pro

+ Add model from specific provider

While higher intelligence models are typically more expensive, they do not all follow the same price-quality curve.

Price: Price per token, represented as USD per million Tokens. Price is a blend of Input & Output token prices (3:1 ratio).

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Intelligence vs. Output Speed

Artificial Analysis Intelligence Index (Version 2, released Feb '25); Output Speed: Output Tokens per Second

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemini 2.5 Pro Preview

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3 mini Reasoning (high)

Grok 3

Nova Pro

Qwen2 72B

+ Add model from specific provider

Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Intelligence vs. End-to-End Response Time

Artificial Analysis Intelligence Index (Version 2, released Feb '25); Seconds to Output 500 Tokens, including reasoning model 'thinking' time; Lower is better

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemini 2.5 Pro Preview

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3 mini Reasoning (high)

Grok 3

Nova Pro

Qwen2 72B

+ Add model from specific provider

End-to-End Response Time: Seconds to receive a 500 token response. Key components:

Input time: Time to receive the first response token
Thinking time (only for reasoning models): Time reasoning models spend outputting tokens to reason prior to providing an answer. Amount of tokens based on the average reasoning tokens across a diverse set of 60 prompts (methodology details).
Answer time: Time to generate 500 output tokens, based on output speed

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Intelligence Index Token Use & Cost

Back to Navigation

Output Tokens Used to Run Artificial Analysis Intelligence Index

Tokens used to run all evaluations in the Artificial Analysis Intelligence Index

Reasoning Tokens

Answer Tokens

+ Add model from specific provider

Artificial Analysis Intelligence Index Tokens Use: The number of tokens required to run all evaluations in the Artificial Analysis Intelligence Index (excluding repeats).

Intelligence vs. Output Tokens Used in Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index (Version 2, released Feb '25); Output Tokens Used in Artificial Analysis Intelligence Index

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemma 3 27B

Gemini 2.5 Pro Preview

Claude 3.7 Sonnet Thinking

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3

Nova Pro

Qwen2 72B

+ Add model from specific provider

Artificial Analysis Intelligence Index Tokens Use: The number of tokens required to run all evaluations in the Artificial Analysis Intelligence Index (excluding repeats).

Cost to Run Artificial Analysis Intelligence Index

Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index

Input Cost

Reasoning Cost

Output Cost

+ Add model from specific provider

Cost to Run Artificial Analysis Intelligence Index: The cost to run the evaluations in the Artificial Analysis Intelligence Index, calculated using the model's input and output token pricing and the number of tokens used across evaluations (excluding repeats).

Intelligence vs. Cost to Run Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index (Version 2, released Feb '25); Cost to Run Intelligence Index

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemini 2.5 Pro Preview

Claude 3.7 Sonnet Thinking

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3

Nova Pro

+ Add model from specific provider

Context Window

Back to Navigation

Context Window

Context Window: Tokens Limit; Higher is better

+ Add model from specific provider

Larger context windows are relevant to RAG (Retrieval Augmented Generation) LLM workflows which typically involve reasoning and information retrieval of large amounts of data.

Context window: Maximum number of combined input & output tokens. Output tokens commonly have a significantly lower limit (varied by model).

Intelligence vs. Context Window

Artificial Analysis Intelligence Index (Version 2, released Feb '25); Context Window: Tokens Limit

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemma 3 27B

Gemini 2.5 Pro Preview

Claude 3.7 Sonnet Thinking

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3 mini Reasoning (high)

Grok 3

Nova Pro

Llama 3.1 Nemotron Ultra 253B Reasoning

Qwen2 72B

+ Add model from specific provider

Context window: Maximum number of combined input & output tokens. Output tokens commonly have a significantly lower limit (varied by model).

Pricing

Back to Navigation

Pricing: Input and Output Prices

Price: USD per 1M Tokens

Input price

Output price

+ Add model from specific provider

Input Price: Price per token included in the request/message sent to the API, represented as USD per million Tokens.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Pricing Comparison of Qwen2 Instruct 72B API Providers

Performance Summary

Back to Navigation

Output Speed vs. Price

Output Speed: Output Tokens per Second; Price: USD per 1M Tokens

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemini 2.5 Flash Preview

Gemini 2.5 Pro Preview

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3 mini Reasoning (high)

Grok 3

Nova Pro

+ Add model from specific provider

Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Price: Price per token, represented as USD per million Tokens. Price is a blend of Input & Output token prices (3:1 ratio).

Latency vs. Output Speed

Latency: Seconds to First Token Received; Output Speed: Output Tokens per Second

Most attractive quadrant

GPT-4o (Nov '24)

GPT-4.1

o4-mini (high)

o3-mini (high)

GPT-4.1 mini

Llama 4 Scout

Llama 4 Maverick

Gemini 2.0 Flash

Gemini 2.5 Flash Preview

Gemini 2.5 Pro Preview

Mistral Large 2 (Nov '24)

DeepSeek R1

DeepSeek V3 (Mar' 25)

Grok 3 mini Reasoning (high)

Grok 3

Nova Pro

Qwen2 72B

+ Add model from specific provider

Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Latency (Time to First Token): Time to first token received, in seconds, after API request sent. For reasoning models which share reasoning tokens, this will be the first reasoning token. For models which do not support streaming, this represents time to receive the completion.

Price: Price per token, represented as USD per million Tokens. Price is a blend of Input & Output token prices (3:1 ratio).

Speed

Measured by Output Speed (tokens per second)

Back to Navigation

Output Speed

Output Tokens per Second; Higher is better

+ Add model from specific provider

Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Output Speed by Input Token Count (Context Length)

Output Tokens per Second; Higher is better

100 input tokens

1k input tokens

10k input tokens

100k input tokens

+ Add model from specific provider

Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Input Tokens Length: Length of tokens provided in the request. See Prompt Options above to see benchmarks of different input prompt lengths across other charts.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Output Speed Variance

Output Tokens per Second; Results by percentile; Higher is better

Median, Other points represent 5th, 25th, 75th, 95th Percentiles respectively

+ Add model from specific provider

Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Boxplot: Shows variance of measurements

Output Speed, Over Time

Output Tokens per Second; Higher is better

+ Add model from specific provider

Output Speed: Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Over time measurement: Median measurement per day, based on 8 measurements each day at different times. Labels represent start of week's measurements.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Latency

Measured by Time (seconds) to First Token

Back to Navigation

Latency: Time To First Answer Token

Seconds to First Answer Token Received; Accounts for Reasoning Model 'Thinking' time

Input processing

Thinking (reasoning models, when applicable)

+ Add model from specific provider

Time To First Answer Token: Time to first answer token received, in seconds, after API request sent. For reasoning models, this includes the 'thinking' time of the model before providing an answer. For models which do not support streaming, this represents time to receive the completion.

Latency: Time To First Token

Seconds to First Token Received; Lower is better

+ Add model from specific provider

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Time to First Token by Input Token Count (Context Length)

Seconds to First Token Received; Lower is better

100 input tokens

1k input tokens

10k input tokens

100k input tokens

+ Add model from specific provider

Input Tokens Length: Length of tokens provided in the request. See Prompt Options above to see benchmarks of different input prompt lengths across other charts.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Time to First Token Variance

Seconds to First Token Received; Results by percentile; Lower is better

Median, Other points represent 5th, 25th, 75th, 95th Percentiles respectively

+ Add model from specific provider

Boxplot: Shows variance of measurements

Time to First Token, Over Time

Seconds to First Token Received; Lower median is better

+ Add model from specific provider

Over time measurement: Median measurement per day, based on 8 measurements each day at different times. Labels represent start of week's measurements.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

End-to-End Response Time

Seconds to output 500 Tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

Back to Navigation

End-to-End Response Time

Seconds to Output 500 Tokens, including reasoning model 'thinking' time; Lower is better

Input processing time

'Thinking' time (reasoning models)

Outputting time

+ Add model from specific provider

End-to-End Response Time: Seconds to receive a 500 token response. Key components:

Input time: Time to receive the first response token
Thinking time (only for reasoning models): Time reasoning models spend outputting tokens to reason prior to providing an answer. Amount of tokens based on the average reasoning tokens across a diverse set of 60 prompts (methodology details).
Answer time: Time to generate 500 output tokens, based on output speed

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

End-to-End Response Time by Input Token Count (Context Length)

Seconds to Output 500 Tokens, including reasoning model 'thinking' time; Lower is better

100 input tokens

1k input tokens

10k input tokens

100k input tokens

+ Add model from specific provider

Input Tokens Length: Length of tokens provided in the request. See Prompt Options above to see benchmarks of different input prompt lengths across other charts.

End-to-End Response Time: Seconds to receive a 500 token response considering input processing time, 'thinking' time of reasoning models, and output speed.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

End-to-End Response Time, Over Time

Seconds to Output 500 Tokens, including reasoning model 'thinking' time; Lower is better

+ Add model from specific provider

End-to-End Response Time: Seconds to receive a 500 token response. Key components:

Input time: Time to receive the first response token
Thinking time (only for reasoning models): Time reasoning models spend outputting tokens to reason prior to providing an answer. Amount of tokens based on the average reasoning tokens across a diverse set of 60 prompts (methodology details).
Answer time: Time to generate 500 output tokens, based on output speed

Over time measurement: Median measurement per day, based on 8 measurements each day at different times. Labels represent start of week's measurements.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

Comparisons to Qwen2 72B

Further details

Model Name	Creator	License	Context Window

o1	OpenAI	Proprietary	200k
o3-mini	OpenAI	Proprietary	200k
o1-preview	OpenAI	Proprietary	128k
o1-mini	OpenAI	Proprietary	128k
GPT-4o (Aug '24)	OpenAI	Proprietary	128k
GPT-4o (May '24)	OpenAI	Proprietary	128k
GPT-4o (Nov '24)	OpenAI	Proprietary	128k
GPT-4o mini	OpenAI	Proprietary	128k
o3	OpenAI	Proprietary	128k
GPT-4.1	OpenAI	Proprietary	1m
o1-pro	OpenAI	Proprietary	200k
GPT-4.1 nano	OpenAI	Proprietary	1m
o4-mini (high)	OpenAI	Proprietary	200k
o3-mini (high)	OpenAI	Proprietary	200k
GPT-4.1 mini	OpenAI	Proprietary	1m
GPT-4o Realtime (Dec '24)	OpenAI	Proprietary	128k
GPT-4o mini Realtime (Dec '24)	OpenAI	Proprietary	128k
GPT-4o (March 2025, chatgpt-4o-latest)	OpenAI	Proprietary	128k
GPT-4.5 (Preview)	OpenAI	Proprietary	128k
GPT-4 Turbo	OpenAI	Proprietary	128k
GPT-4o (ChatGPT)	OpenAI	Proprietary	128k
GPT-4	OpenAI	Proprietary	8k

Llama 3.3 Instruct 70B	Meta	Open	128k
Llama 3.1 Instruct 405B	Meta	Open	128k
Llama 3.2 Instruct 90B (Vision)	Meta	Open	128k
Llama 3.1 Instruct 70B	Meta	Open	128k
Llama 3.2 Instruct 11B (Vision)	Meta	Open	128k
Llama 3.1 Instruct 8B	Meta	Open	128k
Llama 3.2 Instruct 3B	Meta	Open	128k
Llama 3.2 Instruct 1B	Meta	Open	128k
Llama 4 Scout	Meta	Open	10m
Llama 4 Maverick	Meta	Open	1m
Llama 3 Instruct 70B	Meta	Open	8k
Llama 3 Instruct 8B	Meta	Open	8k
Llama 2 Chat 7B	Meta	Open	4k
Llama 2 Chat 70B	Meta	Open	4k
Llama 2 Chat 13B	Meta	Open	4k

Gemini 2.0 Pro Experimental (Feb '25)	Google	Proprietary	2m
Gemini 2.0 Flash (Feb '25)	Google	Proprietary	1m
Gemini 2.0 Flash (experimental)	Google	Proprietary	1m
Gemini 1.5 Pro (Sep '24)	Google	Proprietary	2m
Gemini 1.5 Flash (Sep '24)	Google	Proprietary	1m
Gemini 1.5 Pro (May '24)	Google	Proprietary	2m
Gemma 2 27B	Google	Open	8k
Gemma 2 9B	Google	Open	8k
Gemini 1.5 Flash-8B	Google	Proprietary	1m
Gemini 2.0 Flash Thinking Experimental (Jan '25)	Google	Proprietary	1m
Gemma 3 27B Instruct	Google	Open	128k
Gemma 3 1B Instruct	Google	Open	32k
Gemma 3 12B Instruct	Google	Open	128k
Gemini 2.5 Flash Preview (Reasoning)	Google	Proprietary	1m
Gemini 2.0 Flash Thinking Experimental (Dec '24)	Google	Proprietary	2m
Gemini 2.0 Flash-Lite (Feb '25)	Google	Proprietary	1m
Gemini 2.5 Flash Preview	Google	Proprietary	1m
Gemma 3 4B Instruct	Google	Open	128k
Gemini 2.5 Pro Preview (Mar' 25)	Google	Proprietary	1m
Gemini 2.0 Flash-Lite (Preview)	Google	Proprietary	1m
Gemini 1.5 Flash (May '24)	Google	Proprietary	1m
Gemini 1.0 Pro	Google	Proprietary	33k

Claude 3.5 Sonnet (Oct '24)	Anthropic	Proprietary	200k
Claude 3.5 Sonnet (June '24)	Anthropic	Proprietary	200k
Claude 3 Opus	Anthropic	Proprietary	200k
Claude 3.5 Haiku	Anthropic	Proprietary	200k
Claude 3 Haiku	Anthropic	Proprietary	200k
Claude 3.7 Sonnet (Standard)	Anthropic	Proprietary	200k
Claude 3.7 Sonnet (Extended Thinking)	Anthropic	Proprietary	200k
Claude 3 Sonnet	Anthropic	Proprietary	200k
Claude 2.0	Anthropic	Proprietary	100k
Claude 2.1	Anthropic	Proprietary	200k

Pixtral Large	Mistral	Open	128k
Mistral Large 2 (Nov '24)	Mistral	Open	128k
Mistral Large 2 (Jul '24)	Mistral	Open	128k
Mistral Small 3	Mistral	Open	32k
Mistral Small (Sep '24)	Mistral	Open	33k
Mixtral 8x22B Instruct	Mistral	Open	65k
Pixtral 12B (2409)	Mistral	Open	128k
Ministral 8B	Mistral	Open	128k
Mistral NeMo	Mistral	Open	128k
Ministral 3B	Mistral	Proprietary	128k
Mixtral 8x7B Instruct	Mistral	Open	33k
Codestral-Mamba	Mistral	Open	256k
Codestral (Jan '25)	Mistral	Proprietary	256k
Mistral Saba	Mistral	Proprietary	32k
Mistral Small 3.1	Mistral	Open	128k
Mistral Small (Feb '24)	Mistral	Proprietary	33k
Mistral Large (Feb '24)	Mistral	Proprietary	33k
Mistral 7B Instruct	Mistral	Open	8k
Codestral (May '24)	Mistral	Open	33k
Mistral Medium	Mistral	Proprietary	33k

DeepSeek R1	DeepSeek	Open	128k
DeepSeek R1 Distill Llama 70B	DeepSeek	Open	128k
DeepSeek-V2.5 (Dec '24)	DeepSeek	Open	128k
DeepSeek-Coder-V2	DeepSeek	Open	128k
DeepSeek LLM 67B Chat (V1)	DeepSeek	Open	4k
DeepSeek V3 0324 (Mar' 25)	DeepSeek	Open	128k
DeepSeek Coder V2 Lite Instruct	DeepSeek	Open	128k
DeepSeek R1 Distill Qwen 14B	DeepSeek	Open	128k
DeepSeek R1 Distill Llama 8B	DeepSeek	Open	128k
DeepSeek R1 Distill Qwen 32B	DeepSeek	Open	128k
DeepSeek R1 Distill Qwen 1.5B	DeepSeek	Open	128k
DeepSeek V3 (Dec '24)	DeepSeek	Open	128k
DeepSeek-V2.5	DeepSeek	Open	128k
DeepSeek-V2-Chat	DeepSeek	Open	128k

Sonar	Perplexity	Proprietary	127k
Sonar Reasoning Pro	Perplexity	Proprietary	127k
R1 1776	Perplexity	Open	128k
Sonar Reasoning	Perplexity	Proprietary	127k
Sonar Pro	Perplexity	Proprietary	200k

Grok Beta	xAI	Proprietary	128k
Grok 2 (Dec '24)	xAI	Proprietary	131k
Grok 3 mini Reasoning (high)	xAI	Proprietary	1m
Grok 3	xAI	Proprietary	1m
Grok 3 Reasoning Beta	xAI	Proprietary	1m
Grok 3 mini	xAI	Proprietary	1m

Nova Pro	Amazon	Proprietary	300k
Nova Lite	Amazon	Proprietary	300k
Nova Micro	Amazon	Proprietary	130k

Phi-4	Microsoft Azure	Open	16k
Phi-3 Medium Instruct 14B	Microsoft Azure	Open	128k
Phi-4 Mini Instruct	Microsoft Azure	Open	128k
Phi-3 Mini Instruct 3.8B	Microsoft Azure	Open	4k
Phi-4 Multimodal Instruct	Microsoft Azure	Open	128k

LFM 40B	Liquid AI	Proprietary	32k

Solar Mini	Upstage	Open	4k

DBRX Instruct	Databricks	Open	33k

MiniMax-Text-01	MiniMax	Open	4m

Llama 3.1 Nemotron Instruct 70B	NVIDIA	Open	128k
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)	NVIDIA	Open	128k
Llama 3.3 Nemotron Super 49B v1	NVIDIA	Open	128k

Llama 3.1 Tulu3 405B	Allen Institute for AI	Open	128k

Reka Flash (Sep '24)	Reka AI	Proprietary	128k
Reka Core	Reka AI	Proprietary	128k
Reka Flash (Feb '24)	Reka AI	Proprietary	128k
Reka Edge	Reka AI	Proprietary	128k
Reka Flash 3	Reka AI	Open	128k

DeepHermes 3 - Llama-3.1 8B Preview	Nous Research	Open	128k
Hermes 3 - Llama-3.1 70B	Nous Research	Open	128k
DeepHermes 3 - Mistral 24B Preview	Nous Research	Open	32k

Command-R+ (Aug '24)	Cohere	Open	128k
Command-R+ (Apr '24)	Cohere	Open	128k
Command-R (Mar '24)	Cohere	Open	128k
Aya Expanse 32B	Cohere	Open	128k
Command-R (Aug '24)	Cohere	Open	128k
Command A	Cohere	Open	256k
Aya Expanse 8B	Cohere	Open	8k

Jamba 1.5 Large	AI21 Labs	Open	256k
Jamba 1.5 Mini	AI21 Labs	Open	256k
Jamba 1.6 Mini	AI21 Labs	Open	256k
Jamba 1.6 Large	AI21 Labs	Open	256k
Jamba Instruct	AI21 Labs	Proprietary	256k

Arctic Instruct	Snowflake	Open	4k

Qwen2.5 Max	Alibaba	Proprietary	32k
Qwen2.5 Instruct 72B	Alibaba	Open	131k
Qwen2.5 Coder Instruct 32B	Alibaba	Open	131k
Qwen Turbo	Alibaba	Proprietary	1m
Qwen2 Instruct 72B	Alibaba	Open	131k
Qwen1.5 Chat 110B	Alibaba	Open	32k
Qwen2.5 Instruct 32B	Alibaba	Open	128k
Qwen2.5 Coder Instruct 7B	Alibaba	Open	131k
QwQ 32B	Alibaba	Open	131k
Qwen Chat 72B	Alibaba	Open	34k
QwQ 32B-Preview	Alibaba	Open	33k

Yi-Large	01.AI	Proprietary	32k

OpenChat 3.5 (1210)	OpenChat	Open	8k