Multilingual AI Model Benchmark Compare Leading LLMs by Language

An index assessing multilingual performance in general reasoning across multiple languages. Results are computed across English, Chinese, Hindi, Spanish, French, Arabic, Bengali, Portuguese, Indonesian, Japanese, Swahili, German, Korean, Italian, Yoruba, Burmese. See Multilingual Intelligence Index methodology for further details.

An index assessing multilingual performance in general reasoning across multiple languages. Results are computed across English, Chinese, Hindi, Spanish, French, Arabic, Bengali, Portuguese, Indonesian, Japanese, Swahili, German, Korean, Italian, Yoruba, Burmese. See Multilingual Intelligence Index methodology for further details.

There is a trade-off between model quality and output speed, with higher intelligence models typically having lower output speed.

While higher intelligence models are typically more expensive, they do not all follow the same price-quality curve.

A multilingual version of Massive Multitask Language Understanding, evaluated across multiple languages. Tests general knowledge and reasoning ability in areas like science, humanities, mathematics and more. See methodology for further details.

Price per token included in the request/message sent to the API, represented as USD per million Tokens.

Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Time to first answer token received, in seconds, after API request sent. For reasoning models, this includes the 'thinking' time of the model before providing an answer. For models which do not support streaming, this represents time to receive the completion.