Menu

logo
Artificial Analysis
HOME

Comparison of Models: Intelligence, Performance & Price Analysis

Comparison and analysis of AI models across key performance metrics including quality, price, output speed, latency, context window & others. Click on any model to see detailed metrics. For more details including relating to our methodology, see our FAQs.

Model Comparison Summary

Intelligence:o3-mini logo o3-miniĀ andĀ o1 logo o1Ā are the highest quality models, followed by DeepSeek R1 logo DeepSeek R1 & o1-mini logo o1-mini.Output Speed (tokens/s):DeepSeek R1 Distill Qwen 1.5B logo DeepSeek R1 Distill Qwen 1.5B (369 t/s)Ā andĀ Gemini 2.0 Flash-Lite (Preview) logo Gemini 2.0 Flash-Lite (Preview) (258 t/s)Ā are the fastest models, followed by Ministral 3B logo Ministral 3B & Codestral (Jan '25) logo Codestral (Jan '25).Latency (seconds):Gemini 1.5 Flash (Sep) logo Gemini 1.5 Flash (Sep) (0.10s)Ā and Ā Gemini 1.5 Pro (Sep) logo Gemini 1.5 Pro (Sep) (0.10s)Ā are the lowest latency models, followed by Gemini 1.5 Pro (May) logo Gemini 1.5 Pro (May) & Gemini 1.5 Flash (May) logo Gemini 1.5 Flash (May).Price ($ per M tokens):Llama 3.2 1B logo Llama 3.2 1B ($0.04)Ā andĀ Ministral 3B logo Ministral 3B ($0.04)Ā are the cheapest models, followed by DeepSeek R1 Distill Llama 8B logo DeepSeek R1 Distill Llama 8B & OpenChat 3.5 logo OpenChat 3.5.Context Window:MiniMax-Text-01 logo MiniMax-Text-01 (4m)Ā andĀ Gemini 2.0 Pro Experimental logo Gemini 2.0 Pro Experimental (2m)Ā are the largest context window models, followed by Gemini 1.5 Pro (Sep) logo Gemini 1.5 Pro (Sep) & Gemini 1.5 Pro (May) logo Gemini 1.5 Pro (May).

Highlights

Intelligence
Artificial Analysis Intelligence Index; Higher is better
Speed
Output Tokens per Second; Higher is better
Price
USD per 1M Tokens; Lower is better
Parallel Queries:
Prompt Length:
Further details
Model NameFurther analysis
OpenAI logo
OpenAI logoo1
OpenAI logoo3-mini
OpenAI logoo1-preview
OpenAI logoo1-mini
OpenAI logoGPT-4o (Aug '24)
OpenAI logoGPT-4o (May '24)
OpenAI logoGPT-4o (Nov '24)
OpenAI logoGPT-4o mini
OpenAI logoGPT-4o (ChatGPT)
OpenAI logoo3
OpenAI logoGPT-4 Turbo
OpenAI logoGPT-4
Meta logo
Meta logoLlama 3.3 Instruct 70B
Meta logoLlama 3.1 Instruct 405B
Meta logoLlama 3.2 Instruct 90B (Vision)
Meta logoLlama 3.1 Instruct 70B
Meta logoLlama 3.2 Instruct 11B (Vision)
Meta logoLlama 3.1 Instruct 8B
Meta logoLlama 3.2 Instruct 3B
Meta logoLlama 3.2 Instruct 1B
Meta logoLlama 3 Instruct 70B
Meta logoLlama 3 Instruct 8B
Meta logoLlama 2 Chat 7B
xAI logo
xAI logoGrok 3
xAI logoGrok 3 mini
xAI logoGrok 3 Reasoning Beta
xAI logoGrok 3 mini Reasoning
xAI logoGrok Beta
Google logo
Google logoGemini 2.0 Pro Experimental (Feb '25)
Google logoGemini 2.0 Flash (Feb '25)
Google logoGemini 2.0 Flash (experimental)
Google logoGemini 1.5 Pro (Sep '24)
Google logoGemini 2.0 Flash-Lite (Preview)
Google logoGemini 1.5 Flash (Sep '24)
Google logoGemini 1.5 Pro (May '24)
Google logoGemma 2 27B
Google logoGemma 2 9B
Google logoGemini 1.5 Flash-8B
Google logoGemini 1.5 Flash (May '24)
Google logoGemini Experimental (Dec '24)
Google logoGemini 1.0 Pro
Anthropic logo
Anthropic logoClaude 3.5 Sonnet (Oct '24)
Anthropic logoClaude 3.5 Sonnet (June '24)
Anthropic logoClaude 3 Opus
Anthropic logoClaude 3.5 Haiku
Anthropic logoClaude 3 Haiku
Anthropic logoClaude 3 Sonnet
Anthropic logoClaude 2.1
Anthropic logoClaude 2.0
Mistral logo
Mistral logoPixtral Large
Mistral logoMistral Large 2 (Nov '24)
Mistral logoMistral Large 2 (Jul '24)
Mistral logoMistral Small 3
Mistral logoMistral Small (Sep '24)
Mistral logoMixtral 8x22B Instruct
Mistral logoPixtral 12B (2409)
Mistral logoMinistral 8B
Mistral logoMistral NeMo
Mistral logoMinistral 3B
Mistral logoMixtral 8x7B Instruct
Mistral logoCodestral-Mamba
Mistral logoCodestral (Jan '25)
Mistral logoMistral Saba
Mistral logoMistral Small (Feb '24)
Mistral logoMistral Large (Feb '24)
Mistral logoMistral 7B Instruct
Mistral logoMistral Medium
Mistral logoCodestral (May '24)
DeepSeek logo
DeepSeek logoDeepSeek R1
DeepSeek logoDeepSeek R1 Distill Llama 70B
DeepSeek logoDeepSeek V3
DeepSeek logoDeepSeek-V2.5 (Dec '24)
DeepSeek logoDeepSeek-Coder-V2
DeepSeek logoDeepSeek LLM 67B Chat (V1)
DeepSeek logoDeepSeek R1 Distill Llama 8B
DeepSeek logoDeepSeek R1 Distill Qwen 32B
DeepSeek logoDeepSeek-V2.5
DeepSeek logoDeepSeek R1 Distill Qwen 14B
DeepSeek logoDeepSeek R1 Distill Qwen 1.5B
DeepSeek logoDeepSeek-V2-Chat
Perplexity logo
Perplexity logoSonar
Perplexity logoSonar Pro
Perplexity logoSonar Reasoning
Perplexity logoSonar 3.1 Small
Perplexity logoSonar 3.1 Large
Amazon logo
Amazon logoNova Pro
Amazon logoNova Lite
Amazon logoNova Micro
Microsoft Azure logo
Microsoft Azure logoPhi-4
Microsoft Azure logoPhi-3 Medium Instruct 14B
Upstage logo
Upstage logoSolar Mini
Databricks logo
Databricks logoDBRX Instruct
MiniMax logo
MiniMax logoMiniMax-Text-01
NVIDIA logo
NVIDIA logoLlama 3.1 Nemotron Instruct 70B
Allen Institute for AI logo
Allen Institute for AI logoLlama 3.1 Tulu3 405B
Reka AI logo
Reka AI logoReka Flash (Sep '24)
Reka AI logoReka Core
Reka AI logoReka Flash (Feb '24)
Reka AI logoReka Edge
Cohere logo
Cohere logoCommand-R+ (Aug '24)
Cohere logoCommand-R+ (Apr '24)
Cohere logoCommand-R (Mar '24)
Cohere logoAya Expanse 8B
Cohere logoAya Expanse 32B
Cohere logoCommand-R (Aug '24)
AI21 Labs logo
AI21 Labs logoJamba 1.5 Large
AI21 Labs logoJamba 1.5 Mini
AI21 Labs logoJamba Instruct
Alibaba logo
Alibaba logoQwen2.5 Max
Alibaba logoQwen2.5 Instruct 72B
Alibaba logoQwen2.5 Coder Instruct 32B
Alibaba logoQwen Turbo
Alibaba logoQwen2 Instruct 72B
Alibaba logoQwQ 32B-Preview
Alibaba logoQwen Chat 72B
Alibaba logoQwen2.5 Instruct 32B
Alibaba logoQwen1.5 Chat 110B
01.AI logo
01.AI logoYi-Large
OpenChat logo
OpenChat logoOpenChat 3.5 (1210)

Models compared: OpenAI: GPT 4o Audio, GPT 4o Realtime, GPT 4o Speech Pipeline, GPT-3.5 Turbo, GPT-3.5 Turbo (0125), GPT-3.5 Turbo (0314), GPT-3.5 Turbo (1106), GPT-3.5 Turbo Instruct, GPT-4, GPT-4 Turbo, GPT-4 Turbo (0125), GPT-4 Turbo (1106), GPT-4 Vision, GPT-4o (Aug '24), GPT-4o (ChatGPT), GPT-4o (May '24), GPT-4o (Nov '24), GPT-4o Realtime (Dec '24), GPT-4o mini, GPT-4o mini Realtime (Dec '24), o1, o1-mini, o1-preview, o3, o3-mini, and o3-mini (high), Meta: Code Llama 70B, Llama 2 Chat 13B, Llama 2 Chat 70B, Llama 2 Chat 7B, Llama 3 70B, Llama 3 8B, Llama 3.1 405B, Llama 3.1 70B, Llama 3.1 8B, Llama 3.2 11B (Vision), Llama 3.2 1B, Llama 3.2 3B, Llama 3.2 90B (Vision), and Llama 3.3 70B, Google: Gemini 1.0 Pro, Gemini 1.5 Flash (May), Gemini 1.5 Flash (Sep), Gemini 1.5 Flash-8B, Gemini 1.5 Pro (May), Gemini 1.5 Pro (Sep), Gemini 2.0 Flash, Gemini 2.0 Flash (exp), Gemini 2.0 Flash Thinking exp. (Dec '24), Gemini 2.0 Flash Thinking exp. (Jan '25), Gemini 2.0 Flash-Lite (Preview), Gemini 2.0 Pro Experimental, Gemini Experimental (Nov), Gemma 2 27B, Gemma 2 9B, and Gemma 7B, Anthropic: Claude 2.0, Claude 2.1, Claude 3 Haiku, Claude 3 Opus, Claude 3 Sonnet, Claude 3.5 Haiku, Claude 3.5 Sonnet (June), Claude 3.5 Sonnet (Oct), and Claude Instant, Mistral: Codestral (Jan '25), Codestral (May '24), Codestral-Mamba, Ministral 3B, Ministral 8B, Mistral 7B, Mistral Large (Feb '24), Mistral Large 2 (Jul '24), Mistral Large 2 (Nov '24), Mistral Medium, Mistral NeMo, Mistral Saba, Mistral Small (Feb '24), Mistral Small (Sep '24), Mistral Small 3, Mixtral 8x22B, Mixtral 8x7B, Pixtral 12B, and Pixtral Large, DeepSeek: DeepSeek LLM 67B (V1), DeepSeek R1, DeepSeek R1 Distill Llama 70B, DeepSeek R1 Distill Llama 8B, DeepSeek R1 Distill Qwen 1.5B, DeepSeek R1 Distill Qwen 14B, DeepSeek R1 Distill Qwen 32B, DeepSeek V3, DeepSeek-Coder-V2, DeepSeek-V2, DeepSeek-V2.5, DeepSeek-V2.5 (Dec '24), DeepSeek-VL2, and Janus Pro 7B, Perplexity: PPLX-70B Online, PPLX-7B-Online, Sonar, Sonar 3.1 Huge, Sonar 3.1 Large, Sonar 3.1 Small , Sonar Large, Sonar Pro, Sonar Reasoning, Sonar Reasoning Pro, and Sonar Small, xAI: Grok 2, Grok 3, Grok 3 Reasoning Beta, Grok 3 mini, Grok 3 mini Reasoning, Grok Beta, and Grok-1, OpenChat: OpenChat 3.5, Amazon: Nova Lite, Nova Micro, and Nova Pro, Microsoft Azure: Phi-3 Medium 14B, Phi-3 Mini, and Phi-4, Upstage: Solar Mini, Solar Pro, and Solar Pro (Nov '24), Databricks: DBRX, MiniMax: MiniMax-Text-01, NVIDIA: Cosmos Nemotron 34B and Llama 3.1 Nemotron 70B, StepFun: step-2-16k, step-1-128k, step-1-256k, step-1-32k, step-1-8k, step-1-flash, step-2-16k-exp, and step-2-mini, IBM: Granite 3.0 2B, OpenVoice: Granite 3.0 8B, Reka AI: Reka Core, Reka Edge, Reka Flash (Feb '24), and Reka Flash, Other: LLaVA-v1.5-7B, Cohere: Aya Expanse 32B, Aya Expanse 8B, Command, Command Light, Command R7B, Command-R, Command-R (Mar '24), Command-R+ (Apr '24), and Command-R+, AI21 Labs: Jamba 1.5 Large, Jamba 1.5 Mini, and Jamba Instruct, Snowflake: Arctic, Alibaba: QwQ 32B-Preview, Qwen Chat 72B, Qwen Plus, Qwen Turbo, Qwen1.5 Chat 110B, Qwen1.5 Chat 14B, Qwen1.5 Chat 32B, Qwen1.5 Chat 72B, Qwen1.5 Chat 7B, Qwen2 72B, Qwen2 Instruct 7B, Qwen2 Instruct A14B 57B, Qwen2-VL 72B, Qwen2.5 Coder 32B, Qwen2.5 Instruct 14B, Qwen2.5 Instruct 32B, Qwen2.5 72B, Qwen2.5 Instruct 7B, Qwen2.5 Max, and Qwen2.5 Max 01-29, and 01.AI: Yi-Large.