All Releases•

5 models

StepFun Models: Intelligence, Performance & Price

Artificial Analysis Intelligence Index

* Estimated

Per Intelligence Index Task

Artificial Analysis has benchmarked 5 models from StepFun. Below is a comparison of the key metrics across these models.

  • For intelligence, the top model from StepFun is Step 5 Preview at 44.
  • For output speed, the fastest model is Step 5 Preview at 91 t/s.
  • For latency, Step 5 Preview at 24.13s offers the lowest time to first answer token.
  • For pricing, Step 5 Preview at $1.03 offers the lowest cost per task.

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Speed & Latency

Output Speed

Output tokens per second · Higher is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

All StepFun Releases

Further details

Weights
Provider Benchmarks
Step 5 Preview
StepFun logoStepFun
44
600B
27B active at inference time
1M
$0.5
91
StepFun
Step 3.7 Flash
StepFun logoStepFun
19
198B
11B active at inference time
262k
$0.2
212
StepFunDeepInfra
Step 3.5 Flash 2603
StepFun logoStepFun
17
-
256k
$0.1
137
Not available
StepFun
Step 3.5 Flash
StepFun logoStepFun
17
196B
11B active at inference time
256k
$0.1
130
StepFunSiliconFlow
Step3 VL 10B
StepFun logoStepFun
8
10.2B
66k
-
-
-