Mistral Small (Feb '24): Quality, Performance & Price Analysis

Analysis of Mistral's Mistral Small (Feb '24) and comparison to other AI models across key metrics including quality, price, performance (tokens per second & time to first token), context window & more. Click on any model to compare API providers for that model. For more details including relating to our methodology, see our FAQs.

For analysis of API providers see

Creator:

Mistral

License:

Proprietary

Context window:

33k

Link:

Visit

Comparison Summary

Quality:

Mistral Small (Feb '24) is of lower quality compared to average, with a MMLU score of 0.722 and a Quality Index across evaluations of 50.

Price:

Mistral Small (Feb '24) is cheaper compared to average with a price of $1.50 per 1M Tokens (blended 3:1).
Mistral Small (Feb '24) Input token price: $1.00, Output token price: $3.00 per 1M Tokens.

Speed:

Mistral Small (Feb '24) is slower compared to average, with a output speed of 48.8 tokens per second.

Latency:

Mistral Small (Feb '24) has a lower latency compared to average, taking 0.40s to receive the first token (TTFT).

Context Window:

Mistral Small (Feb '24) has a smaller context windows than average, with a context window of 33k tokens.

Highlights

Quality

Artificial Analysis Quality Index; Higher is better

Speed

Output Tokens per Second; Higher is better

Price

USD per 1M Tokens; Lower is better

Navigation

Further details

Model Name	Creator	License	Context Window

o1-preview	OpenAI	Proprietary	128k
o1-mini	OpenAI	Proprietary	128k
GPT-4o (Aug '24)	OpenAI	Proprietary	128k
GPT-4o (May '24)	OpenAI	Proprietary	128k
GPT-4o mini	OpenAI	Proprietary	128k
GPT-4 Turbo	OpenAI	Proprietary	128k
GPT-3.5 Turbo	OpenAI	Proprietary	16k
GPT-4	OpenAI	Proprietary	8k
GPT-3.5 Turbo Instruct	OpenAI	Proprietary	4k

Llama 3.1 Instruct 405B	Meta	Open	128k
Llama 3.1 Instruct 70B	Meta	Open	128k
Llama 3.1 Instruct 8B	Meta	Open	128k
Llama 3 Instruct 70B	Meta	Open	8k
Llama 3 Instruct 8B	Meta	Open	8k
Llama 2 Chat 70B	Meta	Open	4k
Llama 2 Chat 13B	Meta	Open	4k
Llama 2 Chat 7B	Meta	Open	4k

Gemini 1.5 Pro	Google	Proprietary	2m
Gemini 1.5 Flash	Google	Proprietary	1m
Gemma 2 27B	Google	Open	8k
Gemma 2 9B	Google	Open	8k
Gemma 7B Instruct	Google	Open	8k
Gemini 1.0 Pro	Google	Proprietary	33k

Claude 3.5 Sonnet	Anthropic	Proprietary	200k
Claude 3 Opus	Anthropic	Proprietary	200k
Claude 3 Haiku	Anthropic	Proprietary	200k
Claude 3 Sonnet	Anthropic	Proprietary	200k
Claude 2.1	Anthropic	Proprietary	200k
Claude Instant	Anthropic	Proprietary	100k
Claude 2.0	Anthropic	Proprietary	100k

Mistral Large 2	Mistral	Open	128k
Mixtral 8x22B Instruct	Mistral	Open	65k
Mistral Small (Sep '24)	Mistral	Open	128k
Mistral NeMo	Mistral	Open	128k
Mixtral 8x7B Instruct	Mistral	Open	33k
Codestral-Mamba	Mistral	Open	256k
Pixtral 12B (2409)	Mistral	Open	128k
Mistral Large	Mistral	Proprietary	33k
Mistral Small (Feb '24)	Mistral	Proprietary	33k
Mistral 7B Instruct	Mistral	Open	33k
Mistral Medium	Mistral	Proprietary	33k
Codestral	Mistral	Open	33k

Command-R+ (Aug '24)	Cohere	Open	128k
Command-R (Aug '24)	Cohere	Open	128k
Command-R+ (Apr '24)	Cohere	Open	128k
Command-R (Mar '24)	Cohere	Open	128k
Command	Cohere	Proprietary	4k
Command Light	Cohere	Proprietary	4k

Sonar Large	Perplexity	Proprietary	33k
Sonar Small	Perplexity	Proprietary	33k
Sonar 3.1 Small	Perplexity	Proprietary	131k
Sonar 3.1 Large	Perplexity	Proprietary	131k

Phi-3 Medium Instruct 14B	Microsoft Azure	Open	128k

DBRX Instruct	Databricks	Open	33k

Reka Core	Reka AI	Proprietary	128k
Reka Flash	Reka AI	Proprietary	128k
Reka Edge	Reka AI	Proprietary	64k

Jamba 1.5 Large	AI21 Labs	Open	256k
Jamba 1.5 Mini	AI21 Labs	Open	256k
Jamba Instruct	AI21 Labs	Open	256k

DeepSeek-Coder-V2	DeepSeek	Open	128k
DeepSeek-V2-Chat	DeepSeek	Open	128k
DeepSeek-V2.5	DeepSeek	Open	128k

Qwen2 Instruct 72B	Alibaba	Open	128k
Qwen2.5 Instruct 72B	Alibaba	Open	131k

Yi-Large	01.AI	Proprietary	32k

OpenChat 3.5 (1210)	OpenChat	Open	8k