This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

OpenAI has launched a newer release, o3. We suggest considering it instead.

OpenAI

•

Proprietary model

•

Released December 2024

o1 API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of o1 for your use-case.

Lowest Time per Task

Time per Intelligence Index task (minutes)

Total 2 providers

Lowest Cost per Task

Cost per Intelligence Index task

Total 2 providers

o1 is available through 2 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

Benchmarks of providers are not available for this model.

Please see the models page for o1 for details of the model and its intelligence compared to other models.

Time per Task

Inference time (minutes) per Intelligence Index task · Lower is better

No data available

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better

No data available

Pricing

Cost per Intelligence Index Task: o1

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

No data available

Weighted average cost per Intelligence Index task. Each evaluation’s cost is calculated from input, cache hit, cache write, reasoning, and answer token prices, divided by task count, and weighted by its Intelligence Index weight.

Pricing: Cache Hit, Input, and Output: o1

Price (USD per M Tokens) · Lower is better

Price per token for cached prompts (previously processed), typically offering a significant discount compared to regular input price, represented as USD per million tokens. The values shown here are the cache hit price; cache write and cache storage are billed separately and vary by provider — see "Cache pricing by provider" for detail.

Output Speed vs. Cost per Task: o1

Output speed: output tokens divided by total request time, including time to first token · Weighted average cost (USD) per Intelligence Index task

Most attractive quadrant

No data available

Output tokens, including reasoning tokens, received per second over a request's full duration, from sending the request to receiving the final token. The headline value averages each Performance v3 workload over the past 5 days, then averages the workloads.

Speed

Average of the single-request and multi-turn agentic workloads measured

Output Speed: o1

Output tokens divided by total request time · Includes time to first token · Average of the single-request and multi-turn agentic workloads measured · Higher is better

No data available

Speed and latency metrics average each endpoint's runs over the past 5 days, and the error rate pools them. We run the benchmark every 6 hours, and endpoints of deprecated models every 18 hours.

Latency

Average of the single-request and multi-turn agentic workloads measured

Time to First Answer Token: o1

Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

No data available

Time to first answer token received, in seconds, after API request sent. For reasoning models, this includes the 'thinking' time of the model before providing an answer. For models which do not support streaming, this represents time to receive the completion.

Speed and latency metrics average each endpoint's runs over the past 5 days, and the error rate pools them. We run the benchmark every 6 hours, and endpoints of deprecated models every 18 hours.

Reliability

Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

Endpoint Error Rate: o1

Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

No data available

Share of requests over the past 5 days that the endpoint failed with an error, a rate limit or a timeout. Failures on our side are left out of both counts. Across several workloads, the failures and requests are pooled before dividing.

Speed and latency metrics average each endpoint's runs over the past 5 days, and the error rate pools them. We run the benchmark every 6 hours, and endpoints of deprecated models every 18 hours.

Key Comparison Metrics & API Features



Microsoft Azure	--	--	--	--	200k	Proprietary
OpenAI	--	--	--	--	200k	Proprietary

Frequently Asked Questions

Common questions about o1 providers

o1 is available through 2 API providers: OpenAI and Azure. Each provider offers different performance characteristics and pricing.

o1 is currently available through 2 API providers that we benchmark and track.

The most affordable providers for o1 by blended price are OpenAI ($14.25 per 1M tokens) and Azure ($14.25 per 1M tokens). Blended price uses a 7:2:1 cache hit/input/output token ratio.

The providers with the lowest input token pricing for o1 are OpenAI ($15.00 per 1M input tokens) and Azure ($15.00 per 1M input tokens).

The providers with the lowest output token pricing for o1 are OpenAI ($60.00 per 1M output tokens) and Azure ($60.00 per 1M output tokens).

All 2 providers of o1 support JSON mode for structured output.

All 2 providers of o1 support function calling (tool use).

When choosing a provider for o1, consider: time per task (how quickly the provider completes an Intelligence Index task), latency (for interactive applications requiring quick first responses), pricing (for cost-sensitive workloads), and API features like JSON mode or function calling.

Yes, provider performance can vary over time due to infrastructure changes, load balancing, and updates. We continuously benchmark all providers and display historical performance trends in the "Over Time" charts.

For information about o1's intelligence, capabilities, modalities, and how it compares to other models, see the model overview page. View model overview

o1 API Provider Benchmarking & Analysis

Lowest Time per Task

Lowest Cost per Task

Time per Task

Cost per Task

Pricing

Cost per Intelligence Index Task: o1

Cost per Intelligence Index Task

Pricing: Cache Hit, Input, and Output: o1

Cache Hit

Output Speed vs. Cost per Task: o1

End-to-End Output Speed

Speed

Output Speed: o1

End-to-End Output Speed

Time Period

Latency

Time to First Answer Token: o1

Time to First Answer Token

Time Period

Reliability

Endpoint Error Rate: o1

Endpoint Error Rate

Time Period

Key Comparison Metrics & API Features

Frequently Asked Questions

Where can I access o1?

How many API providers offer o1?

Which provider is cheapest for o1?

Which provider has the lowest input price for o1?

Which provider has the lowest output price for o1?

Which o1 providers support JSON mode?

Which o1 providers support function calling?

How do I choose a provider for o1?

Does provider performance for o1 change over time?

What are the overall capabilities of o1?