This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

OpenAI has launched a newer release, GPT-4. We suggest considering it instead.

All Releases••

Proprietary model

•

Released November 2022

GPT-3.5 Turbo: Intelligence, Performance & Price Analysis

Model summary

N/A
Artificial Analysis Intelligence Index
Unknown out of 4 units for Intelligence.

Performance

N/A
Time per Intelligence Index task (minutes)
Unknown out of 4 units for Performance.
In -Out -
N/A
Cost per Intelligence Index task
Unknown out of 4 units for Cost.

Verbosity

N/A
Output tokens from Intelligence Index
Unknown out of 4 units for Verbosity.

GPT-3.5 Turbo supports text input, outputs text, and has a 4k tokens context window with knowledge up to September 2021.

Updated
Artificial Analysis Intelligence Index · Higher is better
No publicly available API

Time per Task

Inference time (minutes) per Intelligence Index task · Lower is better
No publicly available API
Weighted average cost (USD) per Intelligence Index task · Lower is better
No publicly available API

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Artificial Analysis Intelligence Index by Open Weights / Proprietary

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Evaluations

Evaluations measured independently by Artificial Analysis · AA-PersonalityBench scores are percentile ranks from 1 to 100
See more

Rich, varied, well-crafted language

Well-structured, scannable, answer-first

Truthful, acknowledges uncertainty, non-sycophantic

Use of filler and generic language

AA-PersonalityBenchNew

Personality Indexes

Each axis is one of 8 personality indexes: the mean of its traits’ Elo z-scores, percentile ranked from 1 to 100 across all models evaluated in the benchmark

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Cost to Run Artificial Analysis Intelligence Index

Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens)

Context Window

Context Window

Context window: tokens limit · Higher is better

Further details

Weights
GPT-3.5 Turbo
OpenAI logoOpenAI
-
-
4k
-
-
-
Not available
-

Frequently Asked Questions

Common questions about GPT-3.5 Turbo