Clef-Flash:发布、Decision Index 得分、性能与价格

模型摘要

46
Artificial Analysis Decision Index
Decision Index为 4 档中的第 1 档。

耗时

298 ms
每项任务耗时中位数
耗时为 4 档中的第 4 档。

成本

$32
每百万项任务成本(USD)
成本为 4 档中的第 2 档。

得分

Artificial Analysis Decision Index

Weighted average of AA-Omniscience-Decision, HLE-MultiChoice, When2Call and WildGuardTest · Higher is better

Artificial Analysis Decision Index vs. 每百万项任务成本

Artificial Analysis Decision Index score vs. average cost per 1 million tasks (USD) · Lower is better
Most attractive quadrant
Pareto line

校准

Artificial Analysis Decision Index:校准

模型为所选答案给出的概率对应的准确率 · 宽度为 0.1 的区间(至少 20 个回答) · 各基准权重相同

语言模型的校准即将推出。

耗时

Artificial Analysis Decision Index:每项任务耗时

Median time per task over every task across all Artificial Analysis Decision Index evaluations · Lower is better

成本

Artificial Analysis Decision Index:每百万项任务成本

Average cost per 1 million tasks across all Artificial Analysis Decision Index evaluations at current prices (USD) · Lower is better