Jev 1.14: Release, Decision Index Score, Performance & Price
Model summary
Compared with other decision models, Jev 1.14 is above average on the Decision Index, but somewhat expensive. It's also notably fast. The model supports text input and has a 64k tokens context window.
Jev 1.14 scores 57 on the Artificial Analysis Decision Index, placing it above average among decision models (median: 53).
At 78 ms per task, Jev 1.14 is notably fast (median: 188 ms).
Pricing for Jev 1.14 is $0.042 per 1M input tokens. On average, it costs $42 per 1M tasks to run Jev 1.14 on the Decision Index (somewhat expensive, median: $32).
| Creator | TypeSafe |
|---|---|
| Provider | TypeSafe |
| Input modality | Supports: text |
| Context window | 64k |
| Input price | $0.042 per 1M tokens |
Score
Artificial Analysis Decision Index
Weighted average of AA-Omniscience-Decision, HLE-MultiChoice, When2Call and WildGuardTest · Higher is better
Artificial Analysis Decision Index vs. Cost per 1M Tasks
Artificial Analysis Decision Index score vs. average cost per 1 million tasks (USD) · Lower is better
Most attractive quadrant
Pareto line
Calibration
Artificial Analysis Decision Index Calibration
Accuracy against the probability the model gave its chosen answer · Bins of 0.1 with at least 20 answers · Each benchmark weighted equally
Calibration for language models coming soon.
Time
Artificial Analysis Decision Index: Time per Task
Median time per task over every task across all Artificial Analysis Decision Index evaluations · Lower is better
Cost
Artificial Analysis Decision Index: Cost per 1M Tasks
Average cost per 1 million tasks across all Artificial Analysis Decision Index evaluations at current prices (USD) · Lower is better