GPT-4o (Nov '24): Intelligence, Performance & Price Analysis

Analysis of OpenAI's GPT-4o (Nov '24) and comparison to other AI models across key metrics including quality, price, performance (tokens per second & time to first token), context window & more. Click on any model to compare API providers for that model. For more details including relating to our methodology, see our FAQs.

OpenAI has launched a newer model, GPT-4o (March 2025). We suggest considering this model instead of GPT-4o (Nov '24). See the following pages for a comparison of GPT-4o (March 2025) to other models and GPT-4o (March 2025) API provider benchmarks.

For analysis of API providers see

Comparison Summary

Intelligence:

GPT-4o (Nov '24) is of higher quality compared to average, with a MMLU score of 0.748 and a Intelligence Index across evaluations of 41.

Price:

GPT-4o (Nov '24) is more expensive compared to average with a price of $4.38 per 1M Tokens (blended 3:1).
GPT-4o (Nov '24) Input token price: $2.50, Output token price: $10.00 per 1M Tokens.

Speed:

GPT-4o (Nov '24) is slower compared to average, with a output speed of 88.1 tokens per second.

Latency:

GPT-4o (Nov '24) has a lower latency compared to average, taking 0.96s to receive the first token (TTFT).

Context Window:

GPT-4o (Nov '24) has a smaller context windows than average, with a context window of 130k tokens.

Highlights

Intelligence

Artificial Analysis Intelligence Index; Higher is better

Loading chart...

Speed

Output Tokens per Second; Higher is better

Loading chart...

Price

USD per 1M Tokens; Lower is better

Loading chart...

Navigation

Intelligence Intelligence Index Token Use & Cost Context Window Pricing Performance Summary Speed Latency End-to-End Response Time Comparisons

Note: Some models or providers may not be shown due to not supporting Long prompts. Long prompts have ~10k input tokens and some models have a context window of less than 10k tokens.

GPT-4o (Nov '24) Model Details

Creator
Context Window	128k tokens (~192 A4 pages of size 12 Arial font)
Release Date	November, 2024
Image Input Support	Yes
Open Source (Weights)	No

Further details

Model Name	Creator	License	Context Window

o1	OpenAI	Proprietary	200k
GPT-4o mini	OpenAI	Proprietary	128k
GPT-4.1 nano	OpenAI	Proprietary	1m
o4-mini (high)	OpenAI	Proprietary	200k
GPT-4.1	OpenAI	Proprietary	1m
o3-mini (high)	OpenAI	Proprietary	200k
GPT-4o Realtime (Dec '24)	OpenAI	Proprietary	128k
GPT-4o mini Realtime (Dec '24)	OpenAI	Proprietary	128k
o3	OpenAI	Proprietary	200k
GPT-4o (ChatGPT)	OpenAI	Proprietary	128k
GPT-4.1 mini	OpenAI	Proprietary	1m
o3-mini	OpenAI	Proprietary	200k
o1-pro	OpenAI	Proprietary	200k
o3-pro	OpenAI	Proprietary	200k
o1-preview	OpenAI	Proprietary	128k
o1-mini	OpenAI	Proprietary	128k
GPT-4o (Aug '24)	OpenAI	Proprietary	128k
GPT-4o (May '24)	OpenAI	Proprietary	128k
GPT-4 Turbo	OpenAI	Proprietary	128k
GPT-4o (Nov '24)	OpenAI	Proprietary	128k
GPT-4.5 (Preview)	OpenAI	Proprietary	128k
GPT-4o (March 2025, chatgpt-4o-latest)	OpenAI	Proprietary	128k

Llama 3.3 Instruct 70B	Meta	Open	128k
Llama 3.1 Instruct 405B	Meta	Open	128k
Llama 3.2 Instruct 90B (Vision)	Meta	Open	128k
Llama 3.2 Instruct 11B (Vision)	Meta	Open	128k
Llama 4 Scout	Meta	Open	10m
Llama 4 Maverick	Meta	Open	1m
Llama 3.1 Instruct 70B	Meta	Open	128k
Llama 3.1 Instruct 8B	Meta	Open	128k
Llama 3.2 Instruct 3B	Meta	Open	128k
Llama 3.2 Instruct 1B	Meta	Open	128k

Qwen3 30B A3B 2507	Alibaba	Open	128k
Qwen3 235B A22B 2507 (Reasoning)	Alibaba	Open	132k
Qwen3 0.6B	Alibaba	Open	32k
Qwen3 1.7B	Alibaba	Open	32k
Qwen3 32B (Reasoning)	Alibaba	Open	128k
Qwen3 235B A22B	Alibaba	Open	128k
Qwen3 4B (Reasoning)	Alibaba	Open	32k
Qwen3 32B	Alibaba	Open	128k
Qwen3 30B A3B	Alibaba	Open	128k
Qwen3 1.7B (Reasoning)	Alibaba	Open	32k
Qwen3 30B A3B (Reasoning)	Alibaba	Open	128k
Qwen3 235B A22B (Reasoning)	Alibaba	Open	128k
Qwen3 14B (Reasoning)	Alibaba	Open	128k
Qwen2.5 Coder Instruct 7B	Alibaba	Open	131k
Qwen3 4B	Alibaba	Open	32k
QwQ 32B	Alibaba	Open	131k
Qwen3 Coder 480B A35B	Alibaba	Open	262k
Qwen3 235B A22B 2507 (Non-reasoning)	Alibaba	Open	256k
Qwen3 8B (Reasoning)	Alibaba	Open	128k
Qwen3 8B	Alibaba	Open	128k
Qwen3 0.6B (Reasoning)	Alibaba	Open	32k
Qwen3 14B	Alibaba	Open	128k
Qwen2.5 Max	Alibaba	Proprietary	32k
Qwen2.5 Instruct 72B	Alibaba	Open	131k
Qwen2.5 Coder Instruct 32B	Alibaba	Open	131k
Qwen2.5 Turbo	Alibaba	Proprietary	1m
Qwen2 Instruct 72B	Alibaba	Open	131k
QwQ 32B-Preview	Alibaba	Open	33k
Qwen1.5 Chat 110B	Alibaba	Open	32k
Qwen2.5 Instruct 32B	Alibaba	Open	128k
Qwen Chat 72B	Alibaba	Open	34k

Gemini 2.0 Pro Experimental (Feb '25)	Google	Proprietary	2m
Gemini 2.0 Flash (Feb '25)	Google	Proprietary	1m
Gemma 3 1B Instruct	Google	Open	32k
Gemma 3 27B Instruct	Google	Open	128k
Gemini 2.5 Flash	Google	Proprietary	1m
Gemini 2.5 Pro Preview (May' 25)	Google	Proprietary	1m
Gemini 2.5 Flash-Lite	Google	Proprietary	1m
Gemma 3n E2B Instruct	Google	Open	32k
Gemini 2.0 Flash-Lite (Feb '25)	Google	Proprietary	1m
Gemini 2.5 Flash-Lite (Reasoning)	Google	Proprietary	1m
Gemini 2.5 Flash (Reasoning)	Google	Proprietary	1m
Gemma 3n E4B Instruct Preview (May '25)	Google	Open	32k
Gemini 2.0 Flash Thinking Experimental (Jan '25)	Google	Proprietary	1m
Gemini 2.5 Pro Preview (Mar' 25)	Google	Proprietary	1m
Gemma 3 4B Instruct	Google	Open	128k
Gemma 3 12B Instruct	Google	Open	128k
Gemini 2.5 Pro	Google	Proprietary	1m
Gemma 3n E4B Instruct	Google	Open	32k
Gemini 2.0 Flash (experimental)	Google	Proprietary	1m
Gemini 1.5 Pro (Sep '24)	Google	Proprietary	2m
Gemini 2.0 Flash-Lite (Preview)	Google	Proprietary	1m
Gemini 1.5 Flash (Sep '24)	Google	Proprietary	1m
Gemini 1.5 Flash-8B	Google	Proprietary	1m
Gemini 1.0 Pro	Google	Proprietary	33k
Gemini 2.5 Flash Preview	Google	Proprietary	1m
Gemini 2.5 Flash Preview (Reasoning)	Google	Proprietary	1m
Gemini 1.5 Flash (May '24)	Google	Proprietary	1m
Gemini 1.5 Pro (May '24)	Google	Proprietary	2m
Gemini 1.0 Ultra	Google	Proprietary	33k
Gemini 2.0 Flash Thinking Experimental (Dec '24)	Google	Proprietary	2m

Claude 3.5 Haiku	Anthropic	Proprietary	200k
Claude 3.7 Sonnet (Extended Thinking)	Anthropic	Proprietary	200k
Claude 3.7 Sonnet (Standard)	Anthropic	Proprietary	200k
Claude 4 Opus	Anthropic	Proprietary	200k
Claude 4 Sonnet	Anthropic	Proprietary	200k
Claude 4 Opus (Extended Thinking)	Anthropic	Proprietary	200k
Claude 4 Sonnet (Extended Thinking)	Anthropic	Proprietary	200k
Claude 3.5 Sonnet (Oct '24)	Anthropic	Proprietary	200k
Claude 3.5 Sonnet (June '24)	Anthropic	Proprietary	200k
Claude 3 Opus	Anthropic	Proprietary	200k
Claude 3 Sonnet	Anthropic	Proprietary	200k
Claude 3 Haiku	Anthropic	Proprietary	200k
Claude Instant	Anthropic	Proprietary	100k
Claude 2.0	Anthropic	Proprietary	100k
Claude 2.1	Anthropic	Proprietary	200k

Mistral Large 2 (Nov '24)	Mistral	Open	128k
Pixtral Large	Mistral	Open	128k
Mixtral 8x22B Instruct	Mistral	Open	65k
Ministral 8B	Mistral	Open	128k
Mistral NeMo	Mistral	Open	128k
Ministral 3B	Mistral	Proprietary	128k
Mixtral 8x7B Instruct	Mistral	Open	33k
Codestral (Jan '25)	Mistral	Proprietary	256k
Devstral Small (May '25)	Mistral	Open	256k
Mistral Small 3.2	Mistral	Open	128k
Magistral Small	Mistral	Open	128k
Devstral Medium	Mistral	Proprietary	256k
Mistral Saba	Mistral	Proprietary	32k
Mistral Medium 3	Mistral	Proprietary	128k
Mistral Small 3.1	Mistral	Open	128k
Devstral Small	Mistral	Open	256k
Magistral Medium	Mistral	Proprietary	128k
Mistral Large 2 (Jul '24)	Mistral	Open	128k
Mistral Small 3	Mistral	Open	32k
Mistral Small (Sep '24)	Mistral	Open	33k
Mistral Small (Feb '24)	Mistral	Proprietary	33k
Mistral Large (Feb '24)	Mistral	Proprietary	33k
Pixtral 12B (2409)	Mistral	Open	128k
Codestral-Mamba	Mistral	Open	256k
Codestral (May '24)	Mistral	Open	33k
Mistral Medium	Mistral	Proprietary	33k

DeepSeek R1 Distill Llama 70B	DeepSeek	Open	128k
DeepSeek R1 Distill Qwen 32B	DeepSeek	Open	128k
DeepSeek R1 Distill Qwen 14B	DeepSeek	Open	128k
DeepSeek R1 Distill Llama 8B	DeepSeek	Open	128k
DeepSeek R1 Distill Qwen 1.5B	DeepSeek	Open	128k
DeepSeek R1 0528 (May '25)	DeepSeek	Open	128k
DeepSeek V3 0324 (Mar '25)	DeepSeek	Open	128k
DeepSeek R1 0528 Qwen3 8B	DeepSeek	Open	128k
DeepSeek V3 (Dec '24)	DeepSeek	Open	128k
DeepSeek-V2.5 (Dec '24)	DeepSeek	Open	128k
DeepSeek-Coder-V2	DeepSeek	Open	128k
DeepSeek Coder V2 Lite Instruct	DeepSeek	Open	128k
DeepSeek R1 (Jan '25)	DeepSeek	Open	128k
DeepSeek-V2-Chat	DeepSeek	Open	128k
DeepSeek-V2.5	DeepSeek	Open	128k

Sonar Reasoning	Perplexity	Proprietary	127k
R1 1776	Perplexity	Open	128k
Sonar Pro	Perplexity	Proprietary	200k
Sonar Reasoning Pro	Perplexity	Proprietary	127k
Sonar	Perplexity	Proprietary	127k

Grok 3	xAI	Proprietary	1m
Grok 3 mini Reasoning (Low)	xAI	Proprietary	1m
Grok 4	xAI	Proprietary	256k
Grok 3 Reasoning Beta	xAI	Proprietary	1m
Grok 3 mini Reasoning (high)	xAI	Proprietary	1m
Grok Beta	xAI	Proprietary	128k
Grok 2 (Dec '24)	xAI	Proprietary	131k

Nova Pro	Amazon	Proprietary	300k
Nova Lite	Amazon	Proprietary	300k
Nova Micro	Amazon	Proprietary	130k
Nova Premier	Amazon	Proprietary	1m

Phi-4	Microsoft Azure	Open	16k
Phi-4 Mini Instruct	Microsoft Azure	Open	128k
Phi-3 Medium Instruct 14B	Microsoft Azure	Open	128k
Phi-4 Multimodal Instruct	Microsoft Azure	Open	128k

LFM 40B	Liquid AI	Proprietary	32k

Solar Pro 2 (Reasoning)	Upstage	Proprietary	66k
Solar Pro 2	Upstage	Proprietary	66k
Solar Pro 2 (Preview)	Upstage	Proprietary	64k
Solar Pro 2 (Preview) (Reasoning)	Upstage	Proprietary	64k

DBRX Instruct	Databricks	Open	33k

MiniMax-Text-01	MiniMax	Open	4m
MiniMax M1 80k	MiniMax	Open	1m
MiniMax M1 40k	MiniMax	Open	1m

Llama 3.1 Nemotron Instruct 70B	NVIDIA	Open	128k
Llama 3.3 Nemotron Super 49B v1 (Reasoning)	NVIDIA	Open	128k
Llama Nemotron Super 49B v1.5 (Reasoning)	NVIDIA	Open	128k
Llama Nemotron Super 49B v1.5	NVIDIA	Open	128k
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)	NVIDIA	Open	128k
Llama 3.3 Nemotron Super 49B v1	NVIDIA	Open	128k
Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)	NVIDIA	Open	128k

Kimi K2	Moonshot AI	Open	128k

Llama 3.1 Tulu3 405B	Allen Institute for AI	Open	128k

Granite 3.3 Instruct 8B	IBM	Open	128k

Reka Flash (Sep '24)	Reka AI	Proprietary	128k
Reka Core	Reka AI	Proprietary	128k
Reka Flash (Feb '24)	Reka AI	Proprietary	128k
Reka Edge	Reka AI	Proprietary	128k
Reka Flash 3	Reka AI	Open	128k

DeepHermes 3 - Llama-3.1 8B Preview	Nous Research	Open	128k
Hermes 3 - Llama-3.1 70B	Nous Research	Open	128k
DeepHermes 3 - Mistral 24B Preview	Nous Research	Open	32k

EXAONE 4.0 32B (Reasoning)	LG AI Research	Open	131k
EXAONE 4.0 32B	LG AI Research	Open	131k

GLM-4.5	Z AI	Open	128k

Aya Expanse 32B	Cohere	Open	128k
Command A	Cohere	Open	256k
Command-R+ (Aug '24)	Cohere	Open	128k
Command-R+ (Apr '24)	Cohere	Open	128k
Command-R (Aug '24)	Cohere	Open	128k
Command-R (Mar '24)	Cohere	Open	128k

Jamba 1.7 Mini	AI21 Labs	Open	258k
Jamba 1.6 Mini	AI21 Labs	Open	256k
Jamba 1.6 Large	AI21 Labs	Open	256k
Jamba 1.7 Large	AI21 Labs	Open	256k
Jamba 1.5 Large	AI21 Labs	Open	256k
Jamba 1.5 Mini	AI21 Labs	Open	256k
Jamba Instruct	AI21 Labs	Proprietary	256k

Yi-Large	01.AI	Proprietary	32k

GPT-4o (Nov '24): Intelligence, Performance & Price Analysis

Highlights

Navigation

GPT-4o (Nov '24) Model Details

Comparisons to GPT-4o (Nov '24)