This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

Anthropic has launched a newer release, Claude 2.1. We suggest considering it instead.

All Releases••

Proprietary model

•

Released July 2023

Claude 2.0: Intelligence, Performance & Price Analysis

Model summary

N/A
Artificial Analysis Intelligence Index
Unknown out of 4 units for Intelligence.

Performance

N/A
Time per Intelligence Index task (minutes)
Unknown out of 4 units for Performance.
In -Out -
N/A
Cost per Intelligence Index task
Unknown out of 4 units for Cost.

Verbosity

N/A
Output tokens from Intelligence Index
Unknown out of 4 units for Verbosity.

Claude 2.0 supports text input, outputs text, and has a 100k tokens context window with knowledge up to January 2023.

Updated
Artificial Analysis Intelligence Index · Higher is better
No publicly available API

Time per Task

Inference time (minutes) per Intelligence Index task · Lower is better
No publicly available API
Weighted average cost (USD) per Intelligence Index task · Lower is better
No publicly available API

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Artificial Analysis Intelligence Index by Open Weights / Proprietary

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Cost to Run Artificial Analysis Intelligence Index

Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens)

Context Window

Context Window

Context window: tokens limit · Higher is better

Further details

Weights
Claude 2.0
Anthropic logoAnthropic
-
-
100k
-
-
-
Not available
-

Frequently Asked Questions

Common questions about Claude 2.0