Changelog

Track the latest AI model benchmarks, performance evaluations, and platform updates.

Hide API Endpoints

Changelog begins 24 Dec 2025 for image, video, and speech entries

24 Apr 2026

DeepSeek is back among the leading open weights models with V4 Pro and V4 Flash

DeepSeek is back among the leading open weights models with the release of DeepSeek V4 Pro and V4 Flash, with V4 Pro second only to Kimi K2.6 on the Artificial Analysis Intelligence Index

New language model evaluation results available

Qwen3.6 27B (Non-reasoning)

Intelligence Index: 37 | AA-Omniscience: -53

23 Apr 2026

🔔 New article published

OpenAI's GPT-5.5 is the new leading AI model

Benchmarks and Analysis of GPT-5.5

New language model evaluation results available

DeepSeek V4 Pro (Reasoning, Max Effort)

Intelligence Index: 52 | AA-Omniscience: -10

New language model evaluation results available

DeepSeek V4 Pro (Reasoning, High Effort)

Intelligence Index: 50 | AA-Omniscience: -10

New language model evaluation results available

DeepSeek V4 Flash (Reasoning, Max Effort)

Intelligence Index: 47 | AA-Omniscience: -23

New language model evaluation results available

DeepSeek V4 Flash (Reasoning, High Effort)

Intelligence Index: 45 | AA-Omniscience: -22

New language model evaluation results available

GPT-5.5 (low)

Intelligence Index: 51 | AA-Omniscience: 15

New language model evaluation results available

GPT-5.5 (high)

Intelligence Index: 59 | AA-Omniscience: 18

New language model evaluation results available

GPT-5.5 (Non-reasoning)

Intelligence Index: 41 | AA-Omniscience: -5

New language model evaluation results available

GPT-5.5 (medium)

Intelligence Index: 57 | AA-Omniscience: 17

New language model evaluation results available

GPT-5.5 (xhigh)

Intelligence Index: 60 | AA-Omniscience: 20

New language model evaluation results available

Ling-2.6-1T

Intelligence Index: 34 | AA-Omniscience: -51

New language model evaluation results available

Qwen3.6 27B (Reasoning)

Intelligence Index: 46 | AA-Omniscience: -20

DeepSeek V4 Flash (Reasoning, Max Effort) on DeepSeek

Performance benchmark now available

DeepSeek V4 Pro (Reasoning, High Effort) on DeepSeek

Performance benchmark now available

DeepSeek V4 Flash (Reasoning, High Effort) on DeepSeek

Performance benchmark now available

DeepSeek V4 Pro (Reasoning, Max Effort) on DeepSeek

Performance benchmark now available

GPT-5.5 (low) on OpenAI

Performance benchmark now available

GPT-5.5 (Non-reasoning) on OpenAI

Performance benchmark now available

GPT-5.5 (medium) on OpenAI

Performance benchmark now available

GPT-5.5 (high) on OpenAI

Performance benchmark now available

GPT-5.5 (xhigh) on OpenAI

Performance benchmark now available

Kimi K2.6 on Together.ai

Performance benchmark now available

Ling-2.6-1T on Ant Group

Performance benchmark now available

Qwen3.6 27B (Reasoning) on Alibaba Cloud

Performance benchmark now available

22 Apr 2026

New language model evaluation results available

MiMo-V2.5-Pro

Intelligence Index: 54 | AA-Omniscience: 4

MiMo-V2.5-Pro on Xiaomi

Performance benchmark now available

21 Apr 2026

New language model evaluation results available

Claude Opus 4.7 (Non-reasoning, High Effort)

Intelligence Index: 52 | AA-Omniscience: 14

New language model evaluation results available

Qwen3.6 35B A3B (Non-reasoning)

Intelligence Index: 32 | AA-Omniscience: -60

New language model evaluation results available

Ling 2.6 Flash

Intelligence Index: 26 | AA-Omniscience: -66

Ling 2.6 Flash on Novita

Performance benchmark now available

Gemma 4 26B A4B (Reasoning) on Cloudflare

Performance benchmark now available

Kimi K2.6 on Cloudflare

Performance benchmark now available

Claude Opus 4.7 (Non-reasoning, High Effort) on Amazon Bedrock

Performance benchmark now available

Claude Opus 4.7 (Non-reasoning, High Effort) on Anthropic

Performance benchmark now available

Qwen3.6 35B A3B (Non-reasoning) on Clarifai

Performance benchmark now available

Qwen3.6 35B A3B (Non-reasoning) on Parasail

Performance benchmark now available

Qwen3.6 35B A3B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.6 35B A3B (Reasoning) on Clarifai

Performance benchmark now available

Qwen3.6 35B A3B (Non-reasoning) on Alibaba Cloud

Performance benchmark now available

Qwen3.6 35B A3B (Reasoning) on Parasail

Performance benchmark now available

Qwen3.6 35B A3B (Reasoning) on DeepInfra

Performance benchmark now available

Kimi K2.6 on Parasail

Performance benchmark now available

Kimi K2.6 on Novita

Performance benchmark now available

Qwen3.6 Max Preview on Alibaba Cloud

Performance benchmark now available

Kimi K2.6 on Fireworks

Performance benchmark now available

Kimi K2.6 on Kimi

Performance benchmark now available

20 Apr 2026

🔔 New article published

Kimi K2.6: The new leading open weights model

Benchmarks and Analysis of Kimi K2.6

New language model evaluation results available

Kimi K2.6

Intelligence Index: 54 | AA-Omniscience: 6

19 Apr 2026

New language model evaluation results available

Qwen3.6 Max Preview

Intelligence Index: 52 | AA-Omniscience: 10

17 Apr 2026

🔔 New article published

Opus 4.7: Everything you need to know

Benchmarks and Analysis of Opus 4.7

New language model evaluation results available

Qwen3.6 35B A3B (Reasoning)

Intelligence Index: 43 | AA-Omniscience: -21

Qwen3.6 35B A3B (Reasoning) on Alibaba Cloud

Performance benchmark now available

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) on Anthropic

Performance benchmark now available

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) on Google

Performance benchmark now available

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) on Microsoft Azure

Performance benchmark now available

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) on Amazon Bedrock

Performance benchmark now available

Qwen3.5 397B A17B (Non-reasoning) on Together.ai

Performance benchmark now available

16 Apr 2026

New language model evaluation results available

Claude Opus 4.7 (Adaptive Reasoning, Max Effort)

Intelligence Index: 57 | AA-Omniscience: 26

New model in Text to Image Leaderboard

ImagineArt 2.0

Text to Image ELO: 1178

15 Apr 2026

New language model evaluation results available

JT-MINI

Intelligence Index: 25 | AA-Omniscience: -65

DeepSeek V3.2 (Reasoning) on DeepInfra

Performance benchmark now available

14 Apr 2026

Gemma 4 31B (Reasoning) on DeepInfra

Performance benchmark now available

MiniMax-M2.7 on Fireworks

Performance benchmark now available

MiniMax-M2.7 on Together.ai

Performance benchmark now available

Gemma 4 26B A4B (Reasoning) on Clarifai

Performance benchmark now available

Gemma 4 31B (Reasoning) on Weights & Biases

Performance benchmark now available

13 Apr 2026

🔔 New article published

Sub-32B Open Weights

Benchmark and analyses with focus on Qwen3.5 and Gemma 4 families

New language model evaluation results available

Step 3.5 Flash 2603

Intelligence Index: 38 | AA-Omniscience: -44

Gemma 4 26B A4B (Reasoning) on DeepInfra

Performance benchmark now available

Gemma 4 31B (Reasoning) on Together.ai

Performance benchmark now available

GLM-5.1 (Reasoning) on Weights & Biases

Performance benchmark now available

Gemma 4 26B A4B (Reasoning) on GMI

Performance benchmark now available

GLM-5.1 (Reasoning) on Together.ai

Performance benchmark now available

Step 3.5 Flash 2603 on StepFun

Performance benchmark now available

10 Apr 2026

New model added to Speech Arena Leaderboard

MiMo-V2-TTS

Text to Speech ELO: 1023

09 Apr 2026

🔔 New article published

A new look for Artificial Analysis

Same mission, new look

New language model evaluation results available

GLM-5.1 (Non-reasoning)

Intelligence Index: 44 | AA-Omniscience: -21

GLM-5.1 (Non-reasoning) on SiliconFlow

Performance benchmark now available

GLM-5.1 (Non-reasoning) on Novita

Performance benchmark now available

GLM-5.1 (Non-reasoning) on Parasail

Performance benchmark now available

GLM-5.1 (Non-reasoning) on DeepInfra

Performance benchmark now available

GLM-5.1 (Non-reasoning) on FriendliAI

Performance benchmark now available

08 Apr 2026

🔔 New article published

Muse Spark: Meta is back in the AI race

Benchmarks and Analysis of Muse Spark

New language model evaluation results available

Muse Spark

Intelligence Index: 52 | AA-Omniscience: 4

New language model evaluation results available

Trinity Large Thinking

Intelligence Index: 32 | AA-Omniscience: -44

New language model evaluation results available

Grok 4.20 0309 v2 (Reasoning)

Intelligence Index: 49 | AA-Omniscience: 15

New language model evaluation results available

Grok 4.20 0309 v2 (Non-reasoning)

Intelligence Index: 29 | AA-Omniscience: -45

New language model evaluation results available

Qwen3.6 Plus

Intelligence Index: 50 | AA-Omniscience: 3

Trinity Large Thinking on Arcee AI

Performance benchmark now available

Trinity Large Thinking on Parasail

Performance benchmark now available

Grok 4.20 0309 v2 (Reasoning) on xAI

Performance benchmark now available

Grok 4.20 0309 v2 (Non-reasoning) on xAI

Performance benchmark now available

Qwen3.6 Plus on Alibaba Cloud

Performance benchmark now available

07 Apr 2026

New language model evaluation results available

MiMo-V2-Omni-0327

Intelligence Index: 45 | AA-Omniscience: -14

New language model evaluation results available

GLM-5.1 (Reasoning)

Intelligence Index: 51 | AA-Omniscience: 2

New language model evaluation results available

Qwen3.5 Omni Flash

Intelligence Index: 26 | AA-Omniscience: -66

GLM-5.1 (Reasoning) on SiliconFlow

Performance benchmark now available

GLM-5.1 (Reasoning) on FriendliAI

Performance benchmark now available

GLM-5.1 (Reasoning) on DeepInfra

Performance benchmark now available

GLM-5.1 (Reasoning) on Fireworks

Performance benchmark now available

GLM-5.1 (Reasoning) on GMI

Performance benchmark now available

GLM-5.1 (Reasoning) on Novita

Performance benchmark now available

GLM-5.1 (Reasoning) on Parasail

Performance benchmark now available

Qwen3.5 Omni Flash on Alibaba Cloud

Performance benchmark now available

Nova 2.0 Lite (high) on Amazon Bedrock

Performance benchmark now available

Nova 2.0 Omni (medium) on Amazon Bedrock

Performance benchmark now available

Nova 2.0 Lite (high) on Amazon Bedrock

Performance benchmark now available

New model added to Speech Arena Leaderboard

MAI-Voice-1

Text to Speech ELO: 1021

06 Apr 2026

🔔 New article published

Gemma 4: Google on the American open weights frontier

Benchmarks and Analysis of Gemma 4 models

New language model evaluation results available

Solar Pro 3

Intelligence Index: 26 | AA-Omniscience: -54

New language model evaluation results available

Gemma 4 26B A4B (Non-reasoning)

Intelligence Index: 27 | AA-Omniscience: -62

New language model evaluation results available

Gemma 4 31B (Non-reasoning)

Intelligence Index: 32 | AA-Omniscience: -51

New language model evaluation results available

Gemma 4 E4B (Non-reasoning)

Intelligence Index: 15 | AA-Omniscience: -42

New language model evaluation results available

Gemma 4 E2B (Non-reasoning)

Intelligence Index: 12 | AA-Omniscience: -61

Gemma 4 31B (Reasoning) on GMI

Performance benchmark now available

MiniMax-M2.5 on Lightning AI

Performance benchmark now available

03 Apr 2026

New language model evaluation results available

Gemma 4 E4B (Reasoning)

Intelligence Index: 19 | AA-Omniscience: -20

New language model evaluation results available

Gemma 4 E2B (Reasoning)

Intelligence Index: 15 | AA-Omniscience: -24

Gemma 4 31B (Reasoning) on Google

Performance benchmark now available

Gemma 4 26B A4B (Reasoning) on Google

Performance benchmark now available

Gemma 4 26B A4B (Reasoning) on Parasail

Performance benchmark now available

Gemma 4 26B A4B (Reasoning) on Novita

Performance benchmark now available

Gemma 4 31B (Reasoning) on Parasail

Performance benchmark now available

Gemma 4 31B (Reasoning) on Novita

Performance benchmark now available

GLM-5 (Reasoning) on Lightning AI

Performance benchmark now available

02 Apr 2026

🔔 New article published

Sarvam 105B and Sarvam 30B: India enters the open-weights race

Benchmarks and Analysis of Sarvam 105B and Sarvam 30B

🔔 New article published

MAI-Transcribe-1: Everything you need to know

Benchmarks and Analysis of MAI-Transcribe-1

New language model evaluation results available

Qwen3.5 Omni Plus

Intelligence Index: 39 | AA-Omniscience: -12

New language model evaluation results available

Gemma 4 26B A4B (Reasoning)

Intelligence Index: 31 | AA-Omniscience: -48

New language model evaluation results available

Gemma 4 31B (Reasoning)

Intelligence Index: 39 | AA-Omniscience: -45

Qwen3.5 Omni Plus on Alibaba Cloud

Performance benchmark now available

New Speech to Text model evaluation results available

MAI-Transcribe-1, Azure

01 Apr 2026

New language model evaluation results available

GLM 5V Turbo (Reasoning)

Intelligence Index: 43 | AA-Omniscience: -19

New model added to Speech Arena Leaderboard

Voxtral TTS

Text to Speech ELO: 1049

31 Mar 2026

New model added to Speech Arena Leaderboard

Magpie-Multilingual 357M (Feb 2026)

Text to Speech ELO: 1071

30 Mar 2026

New language model evaluation results available

Nemotron Cascade 2 30B A3B

Intelligence Index: 28 | AA-Omniscience: -52

New language model evaluation results available

KAT Coder Pro V2

Intelligence Index: 44 | AA-Omniscience: -22

Qwen3.5 0.8B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 2B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 4B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 27B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 35B A3B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 122B A10B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 397B A17B (Non-reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 0.8B (Reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 2B (Reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 4B (Reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 27B (Reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 35B A3B (Reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 397B A17B (Reasoning) on DeepInfra

Performance benchmark now available

Qwen3.5 122B A10B (Reasoning) on DeepInfra

Performance benchmark now available

KAT Coder Pro V2 on StreamLake

Performance benchmark now available

26 Mar 2026

New language model evaluation results available

Gemini 3 Deep Think

New model added to Speech Arena Leaderboard

Step TTS 2 (Mar 2026)

Text to Speech ELO: 1150

New model added to Speech Arena Leaderboard

Step Audio EditX (Mar 2026)

Text to Speech ELO: 1101

New Speech to Text model evaluation results available

Cohere Transcribe

25 Mar 2026

🔔 New article published

MiniMax M2.7: Everything you need to know

Benchmarks and Analysis of MiniMax M2.7

New model added to Speech Arena Leaderboard

SIMBA 1.6

Text to Speech ELO: 1062

24 Mar 2026

New language model evaluation results available

NVIDIA Nemotron 3 Nano 4B

Intelligence Index: 15 | AA-Omniscience: -72

New language model evaluation results available

GLM-5-Turbo

Intelligence Index: 47 | AA-Omniscience: -15

New model added to Speech Arena Leaderboard

Fish Audio S2 Pro

Text to Speech ELO: 1121

21 Mar 2026

New language model evaluation results available

Apertus 8B Instruct

Intelligence Index: 6 | AA-Omniscience: -75

New language model evaluation results available

Apertus 70B Instruct

Intelligence Index: 8 | AA-Omniscience: -55

Apertus 70B Instruct on Public AI

Performance benchmark now available

Apertus 8B Instruct on Public AI

Performance benchmark now available

20 Mar 2026

🔔 New article published

MiMo-V2-Pro: Everything you need to know

Benchmarks and Analysis of MiMo-V2-Pro

New language model evaluation results available

Nanbeige4.1-3B

Intelligence Index: 16 | AA-Omniscience: -42

New language model evaluation results available

MiMo-V2-Omni

Intelligence Index: 43 | AA-Omniscience: -17

19 Mar 2026

New language model evaluation results available

GPT-5.4 nano (Non-Reasoning)

Intelligence Index: 24 | AA-Omniscience: -39

New language model evaluation results available

GPT-5.4 nano (medium)

Intelligence Index: 38 | AA-Omniscience: -19

GPT-5.4 mini (medium) on OpenAI

Performance benchmark now available

GPT-5.4 (xhigh) on Microsoft Azure

Performance benchmark now available

GPT-5.4 nano (medium) on OpenAI

Performance benchmark now available

GPT-5.4 nano (Non-Reasoning) on OpenAI

Performance benchmark now available

GPT-5.4 mini (xhigh) on OpenAI

Performance benchmark now available

GPT-5.4 mini (Non-Reasoning) on Microsoft Azure

Performance benchmark now available

GPT-5.4 mini (medium) on Microsoft Azure

Performance benchmark now available

GPT-5.4 mini (xhigh) on Microsoft Azure

Performance benchmark now available

GPT-5.4 mini (Non-Reasoning) on OpenAI

Performance benchmark now available

GPT-5.4 nano (xhigh) on OpenAI

Performance benchmark now available

18 Mar 2026

New language model evaluation results available

GPT-5.4 mini (Non-Reasoning)

Intelligence Index: 23 | AA-Omniscience: -46

New language model evaluation results available

GPT-5.4 mini (medium)

Intelligence Index: 38 | AA-Omniscience: -20

New language model evaluation results available

GPT-5.4 mini (xhigh)

Intelligence Index: 49 | AA-Omniscience: -19

New language model evaluation results available

GPT-5.4 nano (xhigh)

Intelligence Index: 44 | AA-Omniscience: -30

New language model evaluation results available

Sarvam 105B (high)

Intelligence Index: 18 | AA-Omniscience: -60

New language model evaluation results available

Sarvam 30B (high)

Intelligence Index: 12 | AA-Omniscience: -72

New language model evaluation results available

GPT-5.4 (Non-reasoning)

Intelligence Index: 35 | AA-Omniscience: -16

New language model evaluation results available

MiniMax-M2.7

Intelligence Index: 50 | AA-Omniscience: 1

New language model evaluation results available

Mistral Small 4 (Non-reasoning)

Intelligence Index: 19 | AA-Omniscience: -48

New language model evaluation results available

Mistral Small 4 (Reasoning)

Intelligence Index: 28 | AA-Omniscience: -30

Sarvam 30B (high) on Sarvam

Performance benchmark now available

Sarvam 105B (high) on Sarvam

Performance benchmark now available

MiniMax-M2.5 on Nebius

Performance benchmark now available

MiniMax-M2.7 on MiniMax

Performance benchmark now available

MiniMax-M2.7 on Novita

Performance benchmark now available

Mistral Small 4 (Non-reasoning) on Mistral

Performance benchmark now available

Mistral Small 4 (Reasoning) on Mistral

Performance benchmark now available

17 Mar 2026

New language model evaluation results available

MiMo-V2-Pro

Intelligence Index: 49 | AA-Omniscience: 5

gpt-oss-120B (high) on Nebius

Performance benchmark now available

Qwen3 235B A22B 2507 (Reasoning) on Nebius

Performance benchmark now available

Qwen3.5 397B A17B (Non-reasoning) on Nebius

Performance benchmark now available

Qwen3 Next 80B A3B (Reasoning) on Nebius

Performance benchmark now available

Qwen3.5 397B A17B (Reasoning) on Nebius

Performance benchmark now available

Qwen3.5 397B A17B (Non-reasoning) on Nebius

Performance benchmark now available

DeepSeek V3.2 (Non-reasoning) on Nebius

Performance benchmark now available

DeepSeek V3.2 (Reasoning) on Nebius

Performance benchmark now available

16 Mar 2026

Minor scoring update — no change to Intelligence Index

GPT-5.4 (xhigh): CritPT score updated from 20.0% to 23.4%

What's changed

CritPT score updated for GPT-5.4 (xhigh): We observed higher variance in individual CritPT scores for GPT-5.4 (xhigh) and ran additional evaluation runs to confirm. The CritPT score has been updated from 20.0% to 23.4%.
Intelligence Index unchanged: This does not affect the overall Intelligence Index score for GPT-5.4 (xhigh), as the change is within the Intelligence Index margin of error. All other benchmark scores remain unchanged.

Qwen3.5 397B A17B (Reasoning) on Clarifai

Performance benchmark now available

13 Mar 2026

🔔 New article published

NVIDIA Nemotron 3 VoiceChat: Leading the Open Weights Frontier of Conversational Dynamics vs. Speech Reasoning

Independent analysis and benchmarks of NVIDIA Nemotron 3 VoiceChat

DeepSeek V3.2 (Reasoning) on Eigen AI

Performance benchmark now available

DeepSeek V3.2 (Non-reasoning) on Eigen AI

Performance benchmark now available

Qwen3.5 397B A17B (Reasoning) on GMI

Performance benchmark now available

Kimi K2.5 (Non-reasoning) on FriendliAI

Performance benchmark now available

Qwen3.5 27B (Reasoning) on GMI

Performance benchmark now available

Qwen3.5 35B A3B (Reasoning) on GMI

Performance benchmark now available

Qwen3.5 122B A10B (Reasoning) on GMI

Performance benchmark now available

Kimi K2.5 (Reasoning) on FriendliAI

Performance benchmark now available

Qwen3 Coder Next on Amazon Bedrock

Performance benchmark now available

12 Mar 2026

Kimi K2.5 (Reasoning) on Nebius

Performance benchmark now available

GLM-5 (Non-reasoning) on Nebius

Performance benchmark now available

GLM-5 (Reasoning) on Nebius

Performance benchmark now available

11 Mar 2026

🔔 New article published

NVIDIA Nemotron 3 Super: The new leader in open, efficient intelligence

Independent analysis and benchmarks of NVIDIA Nemotron 3 Super

New language model evaluation results available

Grok 4.20 0309 (Non-reasoning)

Intelligence Index: 30 | AA-Omniscience: -43

New language model evaluation results available

Grok 4.20 0309 (Reasoning)

Intelligence Index: 48 | AA-Omniscience: 13

New language model evaluation results available

Qwen3.5 0.8B (Non-reasoning)

Intelligence Index: 10 | AA-Omniscience: -89

New language model evaluation results available

NVIDIA Nemotron 3 Super 120B A12B (Reasoning)

Intelligence Index: 36 | AA-Omniscience: -42

New language model evaluation results available

LongCat Flash Lite

Intelligence Index: 24 | AA-Omniscience: -70

Grok 4.20 0309 (Reasoning) on xAI

Performance benchmark now available

Grok 4.20 0309 (Non-reasoning) on xAI

Performance benchmark now available

NVIDIA Nemotron 3 Super 120B A12B (Reasoning) on Weights & Biases

Performance benchmark now available

NVIDIA Nemotron 3 Super 120B A12B (Reasoning) on Nebius

Performance benchmark now available

NVIDIA Nemotron 3 Super 120B A12B (Reasoning) on Baseten

Performance benchmark now available

NVIDIA Nemotron 3 Super 120B A12B (Reasoning) on DeepInfra

Performance benchmark now available

LongCat Flash Lite on LongCat

Performance benchmark now available

10 Mar 2026

Qwen3.5 397B A17B (Reasoning) on Eigen AI

Performance benchmark now available

MiniMax-M2.5 on Eigen AI

Performance benchmark now available

Qwen3 8B (Non-reasoning) on Eigen AI

Performance benchmark now available

Qwen3 30B A3B (Reasoning) on Eigen AI

Performance benchmark now available

Qwen3 VL 30B A3B (Reasoning) on Eigen AI

Performance benchmark now available

Qwen3 VL 30B A3B Instruct on Eigen AI

Performance benchmark now available

Qwen3 8B (Reasoning) on Eigen AI

Performance benchmark now available

Qwen3 30B A3B (Non-reasoning) on Eigen AI

Performance benchmark now available

Qwen3.5 397B A17B (Non-reasoning) on Eigen AI

Performance benchmark now available

Kimi K2.5 (Reasoning) on Clarifai

Performance benchmark now available

New model in Text to Video Leaderboard

LTX-2.3 Fast

Text to Video ELO: 1121

New model in Text to Video Leaderboard

LTX-2.3 Pro

Text to Video ELO: 1107

New model in Image to Video Leaderboard

LTX-2.3 Fast

Image to Video ELO: 1160

New model in Image to Video Leaderboard

LTX-2.3 Pro

Image to Video ELO: 1158

09 Mar 2026

New language model evaluation results available

Qwen3.5 2B (Non-reasoning)

Intelligence Index: 15 | AA-Omniscience: -83

New language model evaluation results available

Qwen3.5 4B (Non-reasoning)

Intelligence Index: 23 | AA-Omniscience: -75

New language model evaluation results available

Qwen3.5 9B (Non-reasoning)

Intelligence Index: 27 | AA-Omniscience: -71

NVIDIA Nemotron 3 Super 120B A12B (Reasoning) on Lightning AI

Performance benchmark now available

DeepSeek V3.2 (Non-reasoning) on FriendliAI

Performance benchmark now available

Qwen3.5 9B (Reasoning) on Together.ai

Performance benchmark now available

07 Mar 2026

Qwen3 30B A3B 2507 Instruct on Weights & Biases

Performance benchmark now available

06 Mar 2026

New language model evaluation results available

GPT-5.4 Pro (xhigh)

GPT-5.4 (Non-reasoning) on OpenAI

Performance benchmark now available

Qwen2.5 Instruct 72B on SiliconFlow

Performance benchmark now available

MiniMax-M2.5 on FriendliAI

Performance benchmark now available

MiniMax-M2.1 on FriendliAI

Performance benchmark now available

GLM-5 (Reasoning) on FriendliAI

Performance benchmark now available

Qwen3 235B A22B 2507 Instruct on FriendliAI

Performance benchmark now available

MiniMax-M2.5 on Weights & Biases

Performance benchmark now available

Kimi K2.5 (Reasoning) on Weights & Biases

Performance benchmark now available

GLM-5 (Reasoning) on Weights & Biases

Performance benchmark now available

GPT-5.4 Pro (xhigh) on OpenAI

Performance benchmark now available

Step 3.5 Flash on SiliconFlow

Performance benchmark now available

05 Mar 2026

🔔 New article published

Qwen3.5 small models: Everything you need to know

Independent analysis and benchmarks of Qwen 3.5 small models

GPT-5.4 (xhigh) on OpenAI

Performance benchmark now available

GLM-5 (Reasoning) on Baseten

Performance benchmark now available

GLM-5 (Non-reasoning) on Baseten

Performance benchmark now available

Llama 3.1 Instruct 8B on Weights & Biases

Performance benchmark now available

Qwen3 235B A22B 2507 Instruct on Weights & Biases

Performance benchmark now available

Qwen3 Coder 480B A35B Instruct on Weights & Biases

Performance benchmark now available

DeepSeek V3.1 (Non-reasoning) on Weights & Biases

Performance benchmark now available

gpt-oss-20B (high) on Weights & Biases

Performance benchmark now available

gpt-oss-120B (high) on Weights & Biases

Performance benchmark now available

Qwen3 235B A22B 2507 (Reasoning) on Weights & Biases

Performance benchmark now available

Llama 3.3 Instruct 70B on Weights & Biases

Performance benchmark now available

Llama 4 Scout on Weights & Biases

Performance benchmark now available

Phi-4 Mini Instruct on Weights & Biases

Performance benchmark now available

gpt-oss-120B (low) on Weights & Biases

Performance benchmark now available

gpt-oss-20B (low) on Weights & Biases

Performance benchmark now available

GLM-4.7 (Non-reasoning) on Amazon Bedrock

Performance benchmark now available

GLM-4.7-Flash (Non-reasoning) on Amazon Bedrock

Performance benchmark now available

DeepSeek V3.2 (Reasoning) on Amazon Bedrock

Performance benchmark now available

DeepSeek V3.2 (Non-reasoning) on Amazon Bedrock

Performance benchmark now available

GLM-4.7 (Reasoning) on Amazon Bedrock

Performance benchmark now available

GLM-4.7-Flash (Reasoning) on Amazon Bedrock

Performance benchmark now available

04 Mar 2026

New language model evaluation results available

Qwen3.5 2B (Reasoning)

Intelligence Index: 16 | AA-Omniscience: -47

New language model evaluation results available

Qwen3.5 0.8B (Reasoning)

Intelligence Index: 11 | AA-Omniscience: -35

New language model evaluation results available

Qwen3.5 4B (Reasoning)

Intelligence Index: 27 | AA-Omniscience: -57

New language model evaluation results available

Qwen3.5 9B (Reasoning)

Intelligence Index: 32 | AA-Omniscience: -53

Kimi K2.5 (Reasoning) on Amazon Bedrock

Performance benchmark now available

Kimi K2.5 (Non-reasoning) on Nebius

Performance benchmark now available

Gemma 3 27B Instruct on Nebius

Performance benchmark now available

03 Mar 2026

New language model evaluation results available

Gemini 3.1 Flash-Lite Preview

Intelligence Index: 34 | AA-Omniscience: -16

Gemini 3.1 Flash-Lite Preview on Google

Performance benchmark now available

gpt-oss-120B (high) on Nebius

Performance benchmark now available

02 Mar 2026

New language model evaluation results available

Qwen3.5 122B A10B (Non-reasoning)

Intelligence Index: 36 | AA-Omniscience: -54

New language model evaluation results available

Qwen3.5 27B (Non-reasoning)

Intelligence Index: 37 | AA-Omniscience: -47

New language model evaluation results available

Qwen3.5 35B A3B (Non-reasoning)

Intelligence Index: 31 | AA-Omniscience: -62

Qwen3.5 27B (Non-reasoning) on Alibaba Cloud

Performance benchmark now available

Qwen3.5 35B A3B (Non-reasoning) on Alibaba Cloud

Performance benchmark now available

Qwen3.5 122B A10B (Non-reasoning) on Alibaba Cloud

Performance benchmark now available

Kimi K2.5 (Reasoning) on Lightning AI

Performance benchmark now available

New model in Text to Video Leaderboard

P-Video

Text to Video ELO: 1063

New model in Image to Video Leaderboard

P-Video

Image to Video ELO: 1130

01 Mar 2026

Artificial Analysis performance benchmarking methodology

Language model performance benchmarking methodology update (v2.2.0): Expanded prompt set and new default prompt length

What's changed

Refreshed prompt bank: We expanded and diversified prompts across more task types to better reflect real-world usage. This is important because techniques like speculative decoding mean that we see variation in output speeds depending on the type of output.
New default workload: Site-default speed now uses 10k input tokens (was 1k)and we have deprecated performance measurements for 100 token input workloads. 1k, 10k, and 100k remain available via Prompt Options, and the Output Speed by Input Token Count chart is the quickest way to compare workload shapes.

Server location, testing frequency, and median reporting are unchanged.

27 Feb 2026

New Speech to Text model evaluation results available

Gemini 3.1 Pro Preview (High)

26 Feb 2026

⚖️ Artificial Analysis Intelligence benchmarking methodology

Updated to Version 4.0.3

Updated grader model for AA-Omniscience to Gemini 3 Flash Preview (Reasoning)

New language model evaluation results available

LFM2 24B A2B

Intelligence Index: 10 | AA-Omniscience: -59

New language model evaluation results available

GPT-5.3 Codex (xhigh)

Intelligence Index: 54 | AA-Omniscience: 10

LFM2 24B A2B on Together.ai

Performance benchmark now available

GPT-5.3 Codex (xhigh) on OpenAI

Performance benchmark now available

GLM-5 (Non-reasoning) on Fireworks

Performance benchmark now available

Qwen3.5 35B A3B (Reasoning) on Novita

Performance benchmark now available

Qwen3.5 27B (Reasoning) on Novita

Performance benchmark now available

Qwen3.5 122B A10B (Reasoning) on Novita

Performance benchmark now available

25 Feb 2026

New language model evaluation results available

Qwen3.5 122B A10B (Reasoning)

Intelligence Index: 42 | AA-Omniscience: -40

New language model evaluation results available

Qwen3.5 27B (Reasoning)

Intelligence Index: 42 | AA-Omniscience: -42

New language model evaluation results available

Qwen3.5 35B A3B (Reasoning)

Intelligence Index: 37 | AA-Omniscience: -46

Qwen3.5 122B A10B (Reasoning) on Alibaba Cloud

Performance benchmark now available

Qwen3.5 27B (Reasoning) on Alibaba Cloud

Performance benchmark now available

Qwen3.5 35B A3B (Reasoning) on Alibaba Cloud

Performance benchmark now available

New model in Text to Video Leaderboard

PixVerse V5.6

Text to Video ELO: 1215

New model in Image to Video Leaderboard

PixVerse V5.6

Image to Video ELO: 1280

24 Feb 2026

New language model evaluation results available

Mercury 2

Intelligence Index: 33 | AA-Omniscience: -52

Kimi K2.5 (Reasoning) on Nebius

Performance benchmark now available

Mercury 2 on Inception

Performance benchmark now available

New model in Text to Image Leaderboard

Recraft V4

Text to Image ELO: 1130

New model in Text to Image Leaderboard

Recraft V4 Pro

Text to Image ELO: 1138

23 Feb 2026

New Speech to Text model evaluation results available

Pulse STT

New Speech to Text model evaluation results available

Soniox V4

20 Feb 2026

New language model evaluation results available

Tiny Aya Global

Intelligence Index: 5 | AA-Omniscience: -85

New language model evaluation results available

Claude Sonnet 4.6 (Non-reasoning, Low Effort)

Intelligence Index: 43 | AA-Omniscience: -2

Gemini 3.1 Pro Preview on Google

Performance benchmark now available

19 Feb 2026

New language model evaluation results available

Gemini 3.1 Pro Preview

Intelligence Index: 57 | AA-Omniscience: 33

Gemini 3.1 Pro Preview on Google

Performance benchmark now available

New model in Text to Video Leaderboard

Kling 3.0 Omni 720p (Standard)

Text to Video ELO: 1224

New model in Text to Video Leaderboard

Kling 3.0 Omni 1080p (Pro)

Text to Video ELO: 1232

New model in Image to Video Leaderboard

Kling 3.0 Omni 720p (Standard)

Image to Video ELO: 1264

New model in Image to Video Leaderboard

Kling 3.0 Omni 1080p (Pro)

Image to Video ELO: 1284

18 Feb 2026

🔔 New article published

Sonnet 4.6 - Everything you need to know

Independent analysis and benchmarks of Sonnet 4.6

New language model evaluation results available

Tri-21B-think Preview

Intelligence Index: 20 | AA-Omniscience: -55

New language model evaluation results available

Tri-21B-Think

Intelligence Index: 19 | AA-Omniscience: -63

New language model evaluation results available

Qwen3.5 397B A17B (Non-reasoning)

Intelligence Index: 40 | AA-Omniscience: -36

Claude Sonnet 4.6 (Non-reasoning, Low Effort) on Anthropic

Performance benchmark now available

Qwen3.5 397B A17B (Non-reasoning) on Novita

Performance benchmark now available

Qwen3.5 397B A17B (Reasoning) on Parasail

Performance benchmark now available

MiniMax-M2.5 on Parasail

Performance benchmark now available

MiniMax-M2.5 on Together.ai

Performance benchmark now available

GLM-5 (Reasoning) on Together.ai

Performance benchmark now available

MiniMax-M2.5 on SiliconFlow

Performance benchmark now available

MiniMax-M2.5 on SambaNova

Performance benchmark now available

GLM-5 (Reasoning) on Google

Performance benchmark now available

Claude Sonnet 4.6 (Non-reasoning, High Effort) on Amazon Bedrock

Performance benchmark now available

Claude Sonnet 4.6 (Non-reasoning, High Effort) on Microsoft Azure

Performance benchmark now available

Claude Sonnet 4.6 (Non-reasoning, High Effort) on Google

Performance benchmark now available

Claude Sonnet 4.6 (Non-reasoning, High Effort) on Anthropic

Performance benchmark now available

New Speech to Text model evaluation results available

Universal-3 Pro, AssemblyAI

17 Feb 2026

🔔 New article published

AA-WER v2.0: Speech to Text Accuracy Benchmark

Introducing AA-AgentTalk, a new proprietary evaluation dataset focused on voice agent speech, alongside cleaned ground truth transcripts for VoxPopuli and Earnings22.

🔔 New article published

Claude Sonnet 4.6 - New leader in GDPval-AA

Claude Sonnet 4.6 wins in agentic performance of real-life knowledge work

🔔 New article published

Qwen3.5-397B-A17B - Everything you need to know

Independent analysis and benchmarks of Qwen3.5-397B-A17B

New language model evaluation results available

Claude Sonnet 4.6 (Non-reasoning, High Effort)

Intelligence Index: 44 | AA-Omniscience: -3

New language model evaluation results available

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)

Intelligence Index: 52 | AA-Omniscience: 12

New language model evaluation results available

Qwen3.5 397B A17B (Reasoning)

Intelligence Index: 45 | AA-Omniscience: -30

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) on Anthropic

Performance benchmark now available

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) on Microsoft Azure

Performance benchmark now available

Qwen3.5 397B A17B (Reasoning) on Together.ai

Performance benchmark now available

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) on Google

Performance benchmark now available

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) on Amazon Bedrock

Performance benchmark now available

GLM-4.7-Flash (Non-reasoning) on Novita

Performance benchmark now available

GLM-5 (Reasoning) on Parasail

Performance benchmark now available

GLM-5 (Non-reasoning) on DeepInfra

Performance benchmark now available

GLM-5 (Non-reasoning) on SiliconFlow

Performance benchmark now available

MiniMax-M2.5 on DeepInfra

Performance benchmark now available

GLM-4.7 (Reasoning) on Clarifai

Performance benchmark now available

MiniMax-M2.5 on Clarifai

Performance benchmark now available

Qwen3.5 397B A17B (Reasoning) on Novita

Performance benchmark now available

Qwen3.5 397B A17B (Non-reasoning) on Alibaba Cloud

Performance benchmark now available

Qwen3.5 397B A17B (Reasoning) on Alibaba Cloud

Performance benchmark now available

16 Feb 2026

New language model evaluation results available

Magistral Small 1

AA-Omniscience: -43

GLM-5 (Non-reasoning) on Novita

Performance benchmark now available

MiniMax-M2.5 on Fireworks

Performance benchmark now available

13 Feb 2026

🔔 New article published

MiniMax-M2.5: Everything you need to know

Independent analysis and benchmarks of MiniMax-M2.5

New language model evaluation results available

GLM-5 (Non-reasoning)

Intelligence Index: 41 | AA-Omniscience: -11

Qwen3 Coder 30B A3B Instruct on Clarifai

Performance benchmark now available

MiniMax-M2.5 on Novita

Performance benchmark now available

12 Feb 2026

New language model evaluation results available

MiniMax-M2.5

Intelligence Index: 42 | AA-Omniscience: -40

GLM-5 (Reasoning) on Fireworks

Performance benchmark now available

11 Feb 2026

🔔 New article published

GLM-5 - Everything you need to know

Independent analysis and benchmarks of GLM-5

New language model evaluation results available

GLM-5 (Reasoning)

Intelligence Index: 50 | AA-Omniscience: 2

GLM-5 (Reasoning) on DeepInfra

Performance benchmark now available

GLM-5 (Reasoning) on Novita

Performance benchmark now available

New model in Text to Image Leaderboard

grok-imagine-image

Text to Image ELO: 1186

New model in Text to Image Leaderboard

grok-imagine-image-pro

Text to Image ELO: 1151

New model in Image Editing Leaderboard

grok-imagine-image

Image Editing ELO: 1218

New model in Image Editing Leaderboard

grok-imagine-image-pro

Image Editing ELO: 1213

New model in Text to Video Leaderboard

Veo 3.1 Fast

Text to Video ELO: 1203

New model in Text to Video Leaderboard

Veo 3.1

Text to Video ELO: 1208

New model in Text to Video Leaderboard

Kling 3.0 1080p (Pro)

Text to Video ELO: 1246

New model in Text to Video Leaderboard

Kling 3.0 720p (Standard)

Text to Video ELO: 1212

New model in Image to Video Leaderboard

Veo 3.1 Fast

Image to Video ELO: 1272

New model in Image to Video Leaderboard

Veo 3.1

Image to Video ELO: 1246

New model in Image to Video Leaderboard

Kling 3.0 1080p (Pro)

Image to Video ELO: 1283

New model in Image to Video Leaderboard

Kling 3.0 720p (Standard)

Image to Video ELO: 1265

10 Feb 2026

New language model evaluation results available

MiMo-V2-Flash (Feb 2026)

Intelligence Index: 41 | AA-Omniscience: -18

GLM-5 (Reasoning) on SiliconFlow

Performance benchmark now available

08 Feb 2026

MiniMax-M2.5 on MiniMax

Performance benchmark now available

06 Feb 2026

🔔 New article published

Opus 4.6 - Everything you need to know

Independent analysis and benchmarks of Opus 4.6

MiMo-V2-Flash (Feb 2026) on Xiaomi

Performance benchmark now available

New model in Text to Image Leaderboard

Z-Image Base

Text to Image ELO: 1045

New model in Text to Image Leaderboard

Qwen Image Plus 2601

Text to Image ELO: 1079

New model in Text to Image Leaderboard

HunyuanImage 3.0 Instruct (Fal)

Text to Image ELO: 1107

New model in Image Editing Leaderboard

HunyuanImage 3.0 Instruct (Fal)

Image Editing ELO: 1224

05 Feb 2026

🔔 New article published

Opus 4.6 Takes Lead in Agentic Real-World Knowledge Tasks

We worked with Anthropic to benchmark Claude Opus 4.6 ahead of launch - it reached an Elo of 1606 with adaptive thinking, nearly 150 points ahead of GPT-5.2 (xhigh). This implies a win rate of ~70% when compared head-to-head with OpenAI's December 2025 flagship.

New language model evaluation results available