Elephant 9B: Release, Decision Index Score, Performance & Price
Model summary
Compared with other decision models, Elephant 9B is amongst the leading models on the Decision Index and well priced. It's also faster than average. The model supports text input and has a 16k tokens context window.
Elephant 9B scores 65 on the Artificial Analysis Decision Index, placing it well above average among decision models (median: 53).
At 165 ms per task, Elephant 9B is faster than average (median: 188 ms).
Pricing for Elephant 9B is $0.01 per 1M input tokens. On average, it costs $8.4 per 1M tasks to run Elephant 9B on the Decision Index (competitively priced, median: $32).
| Creator | Baseten |
|---|---|
| Provider | Baseten |
| Input modality | Supports: text |
| Context window | 16k |
| Input price | $0.01 per 1M tokens |
Score
Artificial Analysis Decision Index
Weighted average of AA-Omniscience-Decision, HLE-MultiChoice, When2Call and WildGuardTest · Higher is better
Artificial Analysis Decision Index vs. Cost per 1M Tasks
Artificial Analysis Decision Index score vs. average cost per 1 million tasks (USD) · Lower is better
Most attractive quadrant
Pareto line
Calibration
Artificial Analysis Decision Index Calibration
Accuracy against the probability the model gave its chosen answer · Bins of 0.1 with at least 20 answers · Each benchmark weighted equally
Calibration for language models coming soon.
Time
Artificial Analysis Decision Index: Time per Task
Median time per task over every task across all Artificial Analysis Decision Index evaluations · Lower is better
Cost
Artificial Analysis Decision Index: Cost per 1M Tasks
Average cost per 1 million tasks across all Artificial Analysis Decision Index evaluations at current prices (USD) · Lower is better