All Releases•

5 models

StepFun Models: Intelligence, Performance & Price

Artificial Analysis has benchmarked 5 models from StepFun. Below is a comparison of the key metrics across these models.

  • For intelligence, the top model from StepFun is Step 5 Preview at 44.
  • For output speed, the fastest model is Step 3.7 Flash at 197 t/s.
  • For latency, Step 3.7 Flash at 12.65s offers the lowest time to first answer token.
  • For pricing, Step 5 Preview at $0.72 offers the lowest cost per task.

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Intelligence Index Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Artificial Analysis Intelligence Index task, segmented by token type. Lower is better

Speed & Latency

Output Speed

Output tokens per second · Higher is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

All StepFun Releases

Further details

Weights
Provider Benchmarks
Step 5 Preview
StepFun logoStepFun
44
600B
27B active at inference time
1M
$0.5
72
Not available
StepFun
Step 3.7 Flash
StepFun logoStepFun
19
198B
11B active at inference time
262k
$0.2
197
StepFunDeepInfra
Step 3.5 Flash 2603
StepFun logoStepFun
17
-
256k
$0.1
135
Not available
StepFun
Step 3.5 Flash
StepFun logoStepFun
17
196B
11B active at inference time
256k
$0.1
143
StepFunSiliconFlow
Step3 VL 10B
StepFun logoStepFun
8
10.2B
66k
-
-
-