Artificial Analysis Decision Index
Cloudflare
Clef: Release, Decision Index Score, Performance & Price
Model summary
Compared with other decision models, Clef is among the lowest scoring on the Decision Index and particularly expensive. It's also notably slow. The model supports text and image input and has a 66k tokens context window.
Clef scores 49 on the Artificial Analysis Decision Index, placing it at the lower end among decision models (median: 53).
At 309 ms per task, Clef is notably slow (median: 188 ms).
Pricing for Clef is $0.24 per 1M input tokens. On average, it costs $199 per 1M tasks to run Clef on the Decision Index (expensive, median: $32).
| Creator | Cloudflare |
|---|---|
| Provider | Cloudflare |
| Input modality | Supports: text and image |
| Context window | 66k |
| Input price | $0.24 per 1M tokens |
Score
Artificial Analysis Decision Index
Weighted average of AA-Omniscience-Decision, HLE-MultiChoice, When2Call and WildGuardTest · Higher is better
Artificial Analysis Decision Index vs. Cost per 1M Tasks
Artificial Analysis Decision Index score vs. average cost per 1 million tasks (USD) · Lower is better
Most attractive quadrant
Pareto line
Calibration
Artificial Analysis Decision Index Calibration
Accuracy against the probability the model gave its chosen answer · Bins of 0.1 with at least 20 answers · Each benchmark weighted equally
Calibration for language models coming soon.
Time
Artificial Analysis Decision Index: Time per Task
Median time per task over every task across all Artificial Analysis Decision Index evaluations · Lower is better
Cost
Artificial Analysis Decision Index: Cost per 1M Tasks
Average cost per 1 million tasks across all Artificial Analysis Decision Index evaluations at current prices (USD) · Lower is better