This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

Mistral has launched a newer release, Mistral Large 2 (Nov '24). We suggest considering it instead.

Mistral

•

Open weights model

•

Released July 2024

Mistral Large 2 (Jul '24) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Mistral Large 2 (Jul '24) for your use-case.

Lowest Time per Task

Time per Intelligence Index task (minutes)

Total 1 provider

Lowest Cost per Task

Cost per Intelligence Index task

Total 1 provider

Mistral Large 2 (Jul) is available through Amazon.

Benchmarks of providers are not available for this model.

Please see the models page for Mistral Large 2 (Jul '24) for details of the model and its intelligence compared to other models.

Time per Task

Inference time (minutes) per Intelligence Index task · Lower is better

No data available

Cost per Task

Weighted average cost (USD) per Intelligence Index task · Lower is better

No data available

Pricing

Cost per Intelligence Index Task: Mistral Large 2 (Jul '24)

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

No data available

Weighted average cost per Intelligence Index task. Each evaluation’s cost is calculated from input, cache hit, cache write, reasoning, and answer token prices, divided by task count, and weighted by its Intelligence Index weight.

Pricing: Cache Hit, Input, and Output: Mistral Large 2 (Jul '24)

Price (USD per M Tokens) · Lower is better

Price per token for cached prompts (previously processed), typically offering a significant discount compared to regular input price, represented as USD per million tokens. The values shown here are the cache hit price; cache write and cache storage are billed separately and vary by provider — see "Cache pricing by provider" for detail.

Output Speed vs. Cost per Task: Mistral Large 2 (Jul '24)

Output speed: output tokens divided by total request time, including time to first token · Weighted average cost (USD) per Intelligence Index task

Most attractive quadrant

No data available

Output tokens, including reasoning tokens, received per second over a request's full duration, from sending the request to receiving the final token. The headline value averages each Performance v3 workload over the past 5 days, then averages the workloads.

Speed

Average of the single-request and multi-turn agentic workloads measured

Output Speed: Mistral Large 2 (Jul '24)

Output tokens divided by total request time · Includes time to first token · Average of the single-request and multi-turn agentic workloads measured · Higher is better

No data available

Speed and latency metrics average each endpoint's runs over the past 5 days, and the error rate pools them. We run the benchmark every 6 hours, and endpoints of deprecated models every 18 hours.

Latency

Average of the single-request and multi-turn agentic workloads measured

Time to First Answer Token: Mistral Large 2 (Jul '24)

Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

No data available

Time to first answer token received, in seconds, after API request sent. For reasoning models, this includes the 'thinking' time of the model before providing an answer. For models which do not support streaming, this represents time to receive the completion.

Speed and latency metrics average each endpoint's runs over the past 5 days, and the error rate pools them. We run the benchmark every 6 hours, and endpoints of deprecated models every 18 hours.

Reliability

Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

Endpoint Error Rate: Mistral Large 2 (Jul '24)

Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

No data available

Share of requests over the past 5 days that the endpoint failed with an error, a rate limit or a timeout. Failures on our side are left out of both counts. Across several workloads, the failures and requests are pooled before dividing.

Speed and latency metrics average each endpoint's runs over the past 5 days, and the error rate pools them. We run the benchmark every 6 hours, and endpoints of deprecated models every 18 hours.

Key Comparison Metrics & API Features



Amazon Bedrock	--	--	--	--	128k			Open

Frequently Asked Questions

Common questions about Mistral Large 2 (Jul '24) providers

Mistral Large 2 (Jul '24) is available through 1 API provider: Amazon. Each provider offers different performance characteristics and pricing.

Mistral Large 2 (Jul '24) is currently available through 1 API provider that we benchmark and track.

The most affordable provider for Mistral Large 2 (Jul '24) by blended price is Amazon ($2.40 per 1M tokens). Blended price uses a 7:2:1 cache hit/input/output token ratio.

The provider with the lowest input token pricing for Mistral Large 2 (Jul '24) is Amazon ($2.00 per 1M input tokens).

The provider with the lowest output token pricing for Mistral Large 2 (Jul '24) is Amazon ($6.00 per 1M output tokens).

The only provider of Mistral Large 2 (Jul '24) supports function calling (tool use).

When choosing a provider for Mistral Large 2 (Jul '24), consider: time per task (how quickly the provider completes an Intelligence Index task), latency (for interactive applications requiring quick first responses), pricing (for cost-sensitive workloads), and API features like JSON mode or function calling.

Yes, provider performance can vary over time due to infrastructure changes, load balancing, and updates. We continuously benchmark all providers and display historical performance trends in the "Over Time" charts.

For information about Mistral Large 2 (Jul '24)'s intelligence, capabilities, modalities, and how it compares to other models, see the model overview page. View model overview

Mistral Large 2 (Jul '24) API Provider Benchmarking & Analysis

Lowest Time per Task

Lowest Cost per Task

Time per Task

Cost per Task

Pricing

Cost per Intelligence Index Task: Mistral Large 2 (Jul '24)

Cost per Intelligence Index Task

Pricing: Cache Hit, Input, and Output: Mistral Large 2 (Jul '24)

Cache Hit

Output Speed vs. Cost per Task: Mistral Large 2 (Jul '24)

End-to-End Output Speed

Speed

Output Speed: Mistral Large 2 (Jul '24)

End-to-End Output Speed

Time Period

Latency

Time to First Answer Token: Mistral Large 2 (Jul '24)

Time to First Answer Token

Time Period

Reliability

Endpoint Error Rate: Mistral Large 2 (Jul '24)

Endpoint Error Rate

Time Period

Key Comparison Metrics & API Features

Frequently Asked Questions

Where can I access Mistral Large 2 (Jul '24)?

How many API providers offer Mistral Large 2 (Jul '24)?

Which provider is cheapest for Mistral Large 2 (Jul '24)?

Which provider has the lowest input price for Mistral Large 2 (Jul '24)?

Which provider has the lowest output price for Mistral Large 2 (Jul '24)?

Which Mistral Large 2 (Jul '24) providers support function calling?

How do I choose a provider for Mistral Large 2 (Jul '24)?

Does provider performance for Mistral Large 2 (Jul '24) change over time?

What are the overall capabilities of Mistral Large 2 (Jul '24)?