All Releases•

6 models

Cohere Models: Intelligence, Performance & Price

Artificial Analysis has benchmarked 6 models from Cohere. Below is a comparison of the key metrics across these models.

  • For intelligence, the top model from Cohere is Command A+ at 13.
  • For output speed, the fastest model is Command A+ at 168 t/s.
  • For latency, Command A at 1.71s offers the lowest time to first answer token.
  • For pricing, Command A+ at $0.00 and North Mini Code at $0.00 offer the lowest cost per task.

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1
Estimate (independent evaluation forthcoming)

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
No data available

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Speed & Latency

Output Speed

Output tokens per second · Higher is better

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries
Finance & Accounting Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 6 evaluations: GDPval-AA v2.1, AA-Briefcase v1.1, AA-Omniscience, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better

Engineering Index

Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better

Economics Index

Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better

All Cohere Releases

Further details

Weights
Provider Benchmarks
Command A+
Cohere logoCohere
13
218B
25B active at inference time
192k
$0.0
168
Cohere
North Mini Code
Cohere logoCohere
10
30B
3B active at inference time
256k
$0.0
91
Cohere
Command A
Cohere logoCohere
7
111B
256k
$3.3
64
CohereMicrosoft Azure
Command-R+ (Apr '24)
Cohere logoCohere
5
104B
128k
-
-
-
Command-R (Mar '24)
Cohere logoCohere
5
35B
128k
-
-
-
Tiny Aya Global
Cohere logoCohere
5
3.4B
8k
$0.0
-
Cohere