All Releases

Gemini 3.8 Flash vs Mistral Small 4: Release Comparison

Comparison of the Gemini 3.8 Flash and Mistral Small 4 releases: 3 and 2 models respectively, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across all 5 models.

  • For intelligence, Gemini 3.8 Flash scores highest: Gemini 3.8 Flash (High) at 31, against Mistral Small 4 (Reasoning) at 4 for Mistral Small 4.
  • For output speed, Mistral Small 4 is fastest: Mistral Small 4 (Reasoning) at 167 t/s, against Gemini 3.8 Flash (High) at 135 t/s for Gemini 3.8 Flash.
  • For cost per task, Mistral Small 4 is cheapest: Mistral Small 4 (Reasoning) at $0.04, against Gemini 3.8 Flash (Medium) at $6.26 for Gemini 3.8 Flash.
Model Playground

Releases compared

Gemini 3.8 Flash (high)Gemini 3.8 Flash (medium)Gemini 3.8 Flash (low)Mistral Small 4Mistral Small 4 (non-reasoning)
Intelligence Index
31
30
22
4
--
Finance & Accounting
42
42
34
12
--
Strategy & Ops
47
47
35
7
--
Legal
42
42
33
12
--
Healthcare & Medical
38
38
31
9
--
Cost per TaskUSD
$7.77
$6.26
--
$0.04
--
Output SpeedTokens/s
135
--
--
167
167
Time to First Tokens
24.89
--
--
0.74
0.79
Context Window
1M
1M
1M
256k
256k
Creator
Google
Google
Google
Mistral
Mistral
License
Proprietary
Proprietary
Proprietary
Open
Open
Input Modality

Supports: text, image, speech, and video

Supports: text, image, speech, and video

Supports: text, image, speech, and video

Supports: text and image

Supports: text and image

Output Modality

Supports: text

Supports: text

Supports: text

Supports: text

Supports: text

Providers
Google
Google
Google
Mistral
Mistral
Updated

Intelligence

Artificial Analysis Intelligence Index · Higher is better

Speed

Output tokens per second · Higher is better

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1
No publicly available API

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Gemini 3.8 Flash
Pareto line
AA-Briefcase v1.1
AutomationBench-AA

Cost per Task (USD, Log Scale)

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No publicly available API

Speed & Latency

Output Speed

Output tokens per second · Higher is better
No publicly available API

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better

Engineering Index

Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode 2.0, AA-Briefcase v1.1 · Higher is better

Economics Index

Incorporates 4 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, GDP.pdf · Higher is better

Benchmarks

AA-PersonalityBenchNew

Personality Indexes

Each axis is one of 8 personality indexes: the mean of its traits’ Elo z-scores, percentile ranked from 1 to 100 across all models evaluated in the benchmark