All Releases•

1 model

Reflection Models: Intelligence, Performance & Price

Reflection
Reflection

Intelligence

Updated
Beam 1.0Beam 1.0
18

Artificial Analysis Intelligence Index

Time per Task

Beam 1.0Beam 1.0
2.3 min

Per Intelligence Index Task

Cost

Beam 1.0Beam 1.0
$0.28

Per Intelligence Index Task

Artificial Analysis has benchmarked 1 model from Reflection. Below are its key metrics.

  • For intelligence, the top model from Reflection is Beam 1.0 at 18.
  • For speed, Beam 1.0 at 2.3 min has the lowest time per task.
  • For latency, Beam 1.0 at 7.17s offers the lowest time to first answer token.
  • For pricing, Beam 1.0 at $0.28 offers the lowest cost per task.

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Speed & Latency

Time per Intelligence Index Task

Output tokens divided by end-to-end output speed (minutes per Intelligence Index task) · Speed at the model's own endpoint or the median across providers · Lower is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better

Engineering Index

Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode 2.0, AA-Briefcase v1.1 · Higher is better

Economics Index

Incorporates 4 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf · Higher is better

All Reflection Releases

Further details

Weights
Provider Benchmarks
Beam 1.0
Reflection logoReflection
18
501B
23B active at inference time
1M
$0.2
2.3
249
🤗
BasetenCoreWeaveTogether AI
+2
View