Cohere Models: Intelligence, Performance & Price
Artificial Analysis Intelligence Index
* Estimated
Artificial Analysis has benchmarked 6 models from Cohere. Below is a comparison of the key metrics across these models.
- For intelligence, the top model from Cohere is Command A+ at 13.
- For output speed, the fastest model is Command A+ at 209 t/s.
- For latency, Command A at 1.77s offers the lowest time to first answer token.
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Intelligence Index Task
Cost
Cost per Intelligence Index Task
Speed & Latency
Output Speed
Capability Scores
Capability Indexes
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better
Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AA-LCR v1.1, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, MLCR-AA, Humanity's Last Exam, AutomationBench-AA · Higher is better
Incorporates 6 evaluations: AA-Omniscience, Humanity's Last Exam, CritPt, GDPval-AA v2.1, AA-Briefcase v1.1, Terminal-Bench 4.0 · Higher is better
Incorporates 5 evaluations: AA-Omniscience, Humanity's Last Exam, GDPval-AA v2.1, AA-Briefcase v1.1, AA-LCR v1.1 · Higher is better
All Cohere Releases
Further details
Weights | Provider Benchmarks | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Command A+ | 13 | 218B 25B active at inference time | 192k | $0.0 | 209 | ||||
| North Mini Code | 10 | 30B 3B active at inference time | 256k | $0.0 | 83 | ||||
| Command A | 7 | 111B | 256k | $3.3 | 58 | ||||
| Command-R+ (Apr '24) | 5 | 104B | 128k | - | - | - | |||
| Command-R (Mar '24) | 5 | 35B | 128k | - | - | - | |||
| Tiny Aya Global | 5 | 3.4B | 8k | $0.0 | - |