Artificial Analysis Decision Index
Perplexity
Decider v1.2: Release, Decision Index Score, Performance & Price
Model summary
Compared with other decision models, Decider v1.2 is above average on the Decision Index and well priced. It's also slower than average. The model supports text and image input and has a 262k tokens context window.
Decider v1.2 scores 56 on the Artificial Analysis Decision Index, placing it above average among decision models (median: 53).
At 206 ms per task, Decider v1.2 is slower than average (median: 188 ms).
Pricing for Decider v1.2 is $0.02 per 1M input tokens. On average, it costs $15 per 1M tasks to run Decider v1.2 on the Decision Index (competitively priced, median: $32).
| Creator | Perplexity |
|---|---|
| Provider | Perplexity |
| Input modality | Supports: text and image |
| Context window | 262k |
| Input price | $0.02 per 1M tokens |
Score
Artificial Analysis Decision Index
Weighted average of AA-Omniscience-Decision, HLE-MultiChoice, When2Call and WildGuardTest · Higher is better
Artificial Analysis Decision Index vs. Cost per 1M Tasks
Artificial Analysis Decision Index score vs. average cost per 1 million tasks (USD) · Lower is better
Most attractive quadrant
Pareto line
Calibration
Artificial Analysis Decision Index Calibration
Accuracy against the probability the model gave its chosen answer · Bins of 0.1 with at least 20 answers · Each benchmark weighted equally
Calibration for language models coming soon.
Time
Artificial Analysis Decision Index: Time per Task
Median time per task over every task across all Artificial Analysis Decision Index evaluations · Lower is better
Cost
Artificial Analysis Decision Index: Cost per 1M Tasks
Average cost per 1 million tasks across all Artificial Analysis Decision Index evaluations at current prices (USD) · Lower is better