All Releases

Mistral Small 4 vs gpt-oss-120b: Release Comparison

Comparison of the Mistral Small 4 and gpt-oss-120b releases: 2 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 4 models.

  • For intelligence, Mistral Small 4 and gpt-oss-120b tie at 4 (Mistral Small 4 (Reasoning) and gpt-oss-120b (High)).
  • For time per task, Mistral Small 4 is fastest: Mistral Small 4 (Reasoning) at 1.7 min, against gpt-oss-120b (High) at 7.5 min for gpt-oss-120b.
  • For cost per task, Mistral Small 4 is cheapest: Mistral Small 4 (Reasoning) at $0.0399, against gpt-oss-120b (High) at $0.35 for gpt-oss-120b.
Model Playground

Releases compared

Mistral Small 4gpt-oss-120b (high)Mistral Small 4 (non-reasoning)gpt-oss-120b (low)
Intelligence Index
4
4
--
--
Finance & Accounting
12
8
--
--
Strategy & Ops
7
6
--
--
Legal
12
8
--
--
Healthcare & Medical
9
6
--
--
Cost per TaskUSD
$0.0399
$0.35
--
--
Time per TaskMinutes
1.7
7.5
--
--
Time to First Answer Tokens
10.20
15.05
1.62
2.21
Context Window
256k
131k
256k
131k
Creator
Mistral
OpenAI
Mistral
OpenAI
License
Open
Open
Open
Open
Input Modality

Supports: text and image

Supports: text

Supports: text and image

Supports: text

Output Modality

Supports: text

Supports: text

Supports: text

Supports: text

Providers
Mistral
GroqScalewayCoreWeave
+12
Mistral
NebiusSambaNovaGoogle
+11
Updated

Intelligence

Artificial Analysis Intelligence Index · Higher is better

Time per Task

Inference time (minutes) per Intelligence Index task · Lower is better

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line
AA-Briefcase v1.1
AutomationBench-AA

Cost per Task (USD, Log Scale)

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Performance

Time per Intelligence Index Task

Output tokens divided by end-to-end output speed (minutes per Intelligence Index task) · Speed at the model's own endpoint or the median across providers · Lower is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better

Engineering Index

Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Briefcase v1.1 · Higher is better

Economics Index

Incorporates 4 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf · Higher is better