Artificial Analysis LLM Performance Leaderboard
Independent performance benchmarks & pricing across API providers of LLMs. Definitions are below the table.
For further analysis and methodology, see artificialanalysis.ai.
Further Analysis | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
Claude Opus 5 (max) | 1M | Proprietary | 61 | $2.03 | 56 | 64.52 | 73.40 | -- | ||
Claude Opus 5 (xhigh) | 1M | Proprietary | 60 | $1.56 | 52 | 37.38 | 47.07 | -- | ||
Claude Fable 5 (with fallback) | 1M | Proprietary | 60 | $2.75 | 74 | 129.10 | 135.90 | -- | ||
Claude Fable 5 (with fallback) | 1M | Proprietary | 60 | $2.90 | 73 | 108.85 | 115.66 | -- | ||
Claude Fable 5 (with fallback) | 1M | Proprietary | 60 | $7.96 | 71 | 133.11 | 140.19 | -- | ||
GPT-5.6 Sol (max) | 1M | Proprietary | 59 | $1.04 | 64 | 154.71 | 162.47 | -- | ||
Claude Opus 5 (high) | 1M | Proprietary | 59 | $1.06 | 55 | 30.37 | 39.53 | -- | ||
GPT-5.6 Sol (xhigh) | 1M | Proprietary | 58 | $0.68 | 70 | 76.06 | 83.18 | -- | ||
Kimi K3 | 1.05M | Proprietary | 57 | $0.95 | 33 | 157.21 | 233.93 | 61.37 | ||
Claude Opus 5 (medium) | 1M | Proprietary | 56 | $0.62 | 50 | 6.46 | 16.54 | -- | ||
GPT-5.6 Sol (high) | 1M | Proprietary | 56 | $0.45 | 60 | 22.89 | 31.29 | -- | ||
Claude Opus 4.8 (max) | 1M | Proprietary | 56 | $1.80 | 59 | 30.32 | 38.84 | -- | ||
Claude Opus 4.8 (max) | 1M | Proprietary | 56 | $1.78 | 64 | 27.35 | 35.20 | -- | ||
Claude Opus 4.8 (max) | 1M | Proprietary | 56 | $2.39 | 69 | 34.48 | 41.78 | -- | ||
GPT-5.6 Terra (max) | 1M | Proprietary | 55 | $0.82 | 140 | 164.08 | 167.65 | -- | ||
Grok 4.5 (high) | 500k | Proprietary | 54 | $0.31 | 64 | 12.01 | 19.88 | -- | ||
GPT-5.6 Sol (medium) | 1M | Proprietary | 54 | $0.31 | 58 | 15.97 | 24.55 | -- | ||
Claude Sonnet 5 (max) | 1M | Proprietary | 53 | $2.92 | 70 | 206.13 | 213.24 | -- | ||
Claude Sonnet 5 (max) | 1M | Proprietary | 53 | $2.19 | 68 | 195.09 | 202.42 | -- | ||
Claude Sonnet 5 (max) | 1M | Proprietary | 53 | $1.53 | 79 | 191.88 | 198.24 | -- | ||
Claude Sonnet 5 (max) | 1M | Proprietary | 53 | $2.60 | 68 | 173.68 | 180.99 | -- | ||
GPT-5.6 Terra (xhigh) | 1M | Proprietary | 52 | $0.48 | 121 | 20.40 | 24.54 | -- | ||
GPT-5.6 Luna (max) | 1M | Proprietary | 51 | $0.21 | 188 | 139.35 | 142.00 | -- | ||
GLM-5.2 (max) | 205k | Open | 51 | $0.32 | 137 | 7.96 | 26.22 | 14.61 | ||
GLM-5.2 (max) | 1M | Open | 51 | $0.37 | 232 | 1.48 | 12.27 | 8.63 | ||
GLM-5.2 (max) (NVFP4) | 1M | Open | 51 | $0.44 | 144 | 0.83 | 18.18 | 13.88 | ||
GLM-5.2 (max) (FP8) | 1.05M | Open | 51 | -- | 41 | 2.39 | 64.11 | 49.38 | ||
GLM-5.2 (max) (NVFP4) | 1M | Open | 51 | -- | 167 | 1.29 | 16.28 | 11.99 | ||
GLM-5.2 (max) | 262k | Open | 51 | -- | 128 | 1.40 | 20.93 | 15.63 | ||
GLM-5.2 (max) | 261k | Open | 51 | -- | 517 | 0.94 | 5.78 | 3.87 | ||
GLM-5.2 (max) | 262k | Open | 51 | -- | 365 | 0.98 | 7.84 | 5.48 | ||
GLM-5.2 (max) (FP4) | 1.05M | Open | 51 | -- | 50 | 1.07 | 50.91 | 39.88 | ||
GLM-5.2 (max) (FP4) | 432k | Open | 51 | -- | 399 | 1.05 | 7.32 | 5.02 | ||
GLM-5.2 (max) | 1.05M | Open | 51 | -- | 400 | 1.99 | 8.25 | 5.01 | ||
GLM-5.2 (max) | 1M | Open | 51 | -- | 316 | 1.04 | 8.96 | 6.34 | ||
GLM-5.2 (max) | 262k | Open | 51 | -- | 76 | 1.70 | 34.81 | 26.48 | ||
GLM-5.2 (max) (NVFP4) | 262k | Open | 51 | $0.32 | 442 | 0.86 | 6.52 | 4.53 | ||
GLM-5.2 (max) | 1M | Open | 51 | -- | 278 | 1.11 | 10.11 | 7.20 | ||
GLM-5.2 (max) (FP8) | 1.05M | Open | 51 | -- | -- | -- | -- | -- | ||
GLM-5.2 (max) (FP8) | 1.05M | Open | 51 | $0.53 | 57 | 1.39 | 45.02 | 34.90 | ||
Muse Spark 1.1 (xhigh) | 1.05M | Proprietary | 51 | $0.26 | 118 | 1.59 | 22.81 | 16.97 | ||
Claude Opus 5 (low) | 1M | Proprietary | 51 | $0.36 | 55 | 4.08 | 13.19 | -- | ||
Gemini 3.5 Flash AI Studio | 1M | Proprietary | 50 | $0.59 | 183 | 17.39 | 20.12 | -- | ||
Gemini 3.6 Flash AI Studio | 1M | Proprietary | 50 | $0.50 | 235 | 14.86 | 16.99 | -- | ||
GPT-5.6 Sol (low) | 1M | Proprietary | 49 | $0.20 | 55 | 2.97 | 12.02 | -- | ||
GPT-5.6 Luna (xhigh) | 1M | Proprietary | 49 | $0.14 | 167 | 52.41 | 55.40 | -- | ||
GPT-5.6 Terra (high) | 1M | Proprietary | 49 | $0.34 | 121 | 2.93 | 7.07 | -- | ||
Gemini 3.1 Pro Preview (AI Studio) | 1M | Proprietary | 46 | $0.29 | 114 | 26.67 | 31.06 | -- | ||
Gemini 3.1 Pro Preview (Vertex) | 1M | Proprietary | 46 | $0.36 | 124 | 28.43 | 32.45 | -- | ||
GPT-5.6 Luna (high) | 1M | Proprietary | 46 | $0.09 | 155 | 11.26 | 14.48 | -- | ||
Qwen3.7 Max | 991k | Proprietary | 46 | $1.03 | 196 | 2.49 | 17.37 | 12.32 | ||
Qwen3.7 Max (FP8) | 262k | Proprietary | 46 | -- | -- | -- | -- | -- | ||
Qwen3.7 Max | 1M | Proprietary | 46 | $0.52 | 52 | 2.08 | 58.09 | 46.38 | ||
GPT-5.6 Terra (medium) | 1M | Proprietary | 46 | $0.18 | 113 | 1.83 | 6.24 | -- | ||
Gemini 3.5 Flash (medium) | 1M | Proprietary | 45* | -- | 191 | 18.32 | 20.94 | -- | ||
MiniMax-M3 (MXFP8) | 1M | Open | 44 | $0.17 | 73 | 1.32 | 35.68 | 27.49 | ||
MiniMax-M3 | 262k | Open | 44 | $0.12 | 356 | 1.00 | 8.02 | 5.62 | ||
MiniMax-M3 | 1M | Open | 44 | $0.18 | 111 | 0.69 | 23.25 | 18.04 | ||
MiniMax-M3 | 1M | Open | 44 | $0.13 | 98 | 1.24 | 26.79 | 20.45 | ||
MiniMax-M3 (FP8) | 1.05M | Open | 44 | -- | 187 | 1.91 | 15.24 | 10.67 | ||
MiniMax-M3 (FP8) | 1M | Open | 44 | $0.11 | 92 | 1.62 | 28.81 | 21.75 | ||
MiniMax-M3 | 512k | Open | 44 | $0.12 | 80 | 1.33 | 32.63 | 25.04 | ||
MiniMax-M3 | 1.05M | Open | 44 | -- | -- | -- | -- | -- | ||
DeepSeek V4 Pro (max) (FP4) | 1.05M | Open | 44 | -- | 56 | 1.25 | 87.83 | 77.70 | ||
DeepSeek V4 Pro (max) | 1M | Open | 44 | -- | 71 | 1.81 | 70.61 | 61.75 | ||
DeepSeek V4 Pro (max) | 1.05M | Open | 44 | -- | 62 | 1.79 | 80.97 | 71.06 | ||
DeepSeek V4 Pro (max) | 1M | Open | 44 | $0.65 | 146 | 0.84 | 34.23 | 29.97 | ||
DeepSeek V4 Pro (max) (FP8) | 1.05M | Open | 44 | $0.27 | 60 | 1.92 | 83.76 | 73.45 | ||
DeepSeek V4 Pro (max) | 1.05M | Open | 44 | -- | -- | -- | -- | -- | ||
DeepSeek V4 Pro (max) | 1M | Open | 44 | $0.77 | 47 | 1.92 | 105.90 | 93.31 | ||
DeepSeek V4 Pro (max) | 512k | Open | 44 | $0.24 | 326 | 1.03 | 15.97 | 13.41 | ||
DeepSeek V4 Pro (max) | 1.05M | Open | 44 | $0.76 | 175 | 1.72 | 29.50 | 24.93 | ||
DeepSeek V4 Pro (max) | 1M | Open | 44 | $0.04 | 68 | 1.69 | 73.82 | 64.74 | ||
GPT-5.3 Codex (xhigh) | 400k | Proprietary | 44* | -- | 129 | 75.82 | 79.69 | -- | ||
DeepSeek V4 Pro (high) (FP4) | 65.5k | Open | 43 | -- | 60 | 1.18 | 43.01 | 33.43 | ||
DeepSeek V4 Pro (high) | 1.05M | Open | 43 | $0.85 | 176 | 1.26 | 15.44 | 11.33 | ||
DeepSeek V4 Pro (high) | 1M | Open | 43 | -- | 67 | 1.65 | 39.01 | 29.86 | ||
DeepSeek V4 Pro (high) | 1M | Open | 43 | $0.04 | 67 | 1.57 | 38.68 | 29.67 | ||
DeepSeek V4 Pro (high) (FP8) | 1.05M | Open | 43 | $0.27 | 54 | 1.81 | 47.73 | 36.71 | ||
DeepSeek V4 Pro (high) | 1M | Open | 43 | $0.85 | 50 | 1.96 | 52.24 | 40.19 | ||
DeepSeek V4 Pro (high) | 512k | Open | 43 | $0.22 | 324 | 0.94 | 8.64 | 6.15 | ||
DeepSeek V4 Pro (high) | 1M | Open | 43 | $0.71 | 137 | 0.80 | 19.03 | 14.57 | ||
DeepSeek V4 Pro (high) | 1.05M | Open | 43 | -- | 67 | 1.79 | 38.84 | 29.62 | ||
DeepSeek V4 Pro (high) | 131k | Open | 43 | -- | 112 | 0.87 | 23.10 | 17.77 | ||
Claude Opus 4.7 (Non-reasoning, high) | 1M | Proprietary | 43* | -- | 45 | 1.79 | 12.86 | -- | ||
Claude Opus 4.7 (Non-reasoning, high) | 1M | Proprietary | 43* | -- | 63 | 1.70 | 9.59 | -- | ||
MiMo-V2.5-Pro | 1.05M | Open | 42 | $0.04 | 69 | 2.78 | 39.07 | 29.03 | ||
MiMo-V2.5-Pro | 1.05M | Open | 42 | -- | -- | -- | -- | -- | ||
MiMo-V2.5-Pro | 65.5k | Open | 42 | $0.28 | 76 | 0.77 | 33.69 | 26.34 | ||
MiMo-V2.5-Pro | 1M | Open | 42 | $0.03 | 65 | 2.80 | 41.50 | 30.96 | ||
Kimi K2.7 Code (FP4) | 256k | Open | 42 | -- | 24 | 1.89 | 113.34 | 91.03 | ||
Kimi K2.7 Code (FP8) | 65.5k | Open | 42 | -- | 44 | 6.92 | 68.63 | 50.40 | ||
Kimi K2.7 Code | 262k | Open | 42 | -- | 257 | 1.16 | 11.79 | 8.68 | ||
Kimi K2.7 Code | 262k | Open | 42 | $0.16 | 47 | 1.52 | 59.16 | 47.09 | ||
Kimi K2.7 Code | 262k | Open | 42 | $0.27 | 171 | 0.54 | 16.45 | 13.00 | ||
Kimi K2.7 Code | 262k | Open | 42 | -- | 49 | 3.25 | 58.66 | 45.26 | ||
Kimi K2.7 Code (NVFP4) | 262k | Open | 42 | $0.19 | 463 | 0.64 | 6.54 | 4.82 | ||
Kimi K2.7 Code | 262k | Open | 42 | -- | 149 | 1.05 | 19.43 | 15.01 | ||
Kimi K2.7 Code | 262k | Open | 42 | -- | 58 | 0.90 | 48.23 | 38.66 | ||
Kimi K2.7 Code | 262k | Open | 42 | $0.45 | 283 | 0.53 | 10.15 | 7.86 | ||
Kimi K2.7 Code | 256k | Open | 42 | -- | 48 | 2.89 | 60.19 | 46.80 | ||
Claude Sonnet 5 (Non-reasoning) | 1M | Proprietary | 42 | $0.37 | 57 | 1.42 | 10.25 | -- | ||
Claude Sonnet 5 (Non-reasoning) | 524k | Proprietary | 42 | $0.42 | 67 | 2.78 | 10.29 | -- | ||
Hy3 | 262k | Open | 41 | $0.03 | 58 | 2.67 | 45.46 | 34.24 | ||
Hy3 (FP8) | 262k | Open | 41 | $0.03 | 46 | 0.68 | 54.85 | 43.34 | ||
Hy3 | 262k | Open | 41 | $0.03 | 71 | 3.45 | 38.74 | 28.23 | ||
GPT-5.6 Sol (Non-reasoning) | 1M | Proprietary | 41 | $0.20 | 54 | 1.03 | 10.33 | -- | ||
Nex-N2-Pro (FP8) | 262k | Open | 41 | -- | 132 | 1.65 | 20.64 | 15.19 | ||
Inkling | 262k | Open | 41 | -- | 65 | 1.89 | 40.60 | 30.97 | ||
GPT-5.6 Terra (low) | 1M | Proprietary | 40 | $0.15 | 103 | 1.78 | 6.62 | -- | ||
DeepSeek V4 Flash (max) | 1.05M | Open | 40 | -- | -- | -- | -- | -- | ||
DeepSeek V4 Flash (max) | 1M | Open | 40 | -- | 187 | 0.70 | 33.47 | 30.09 | ||
DeepSeek V4 Flash (max) (FP4) | 1.05M | Open | 40 | -- | 28 | 1.24 | 218.08 | 199.10 | ||
DeepSeek V4 Flash (max) (FP8) | 1.05M | Open | 40 | $0.07 | 35 | 2.02 | 175.13 | 158.95 | ||
DeepSeek V4 Flash (max) (FP8) | 1.05M | Open | 40 | -- | 43 | 1.74 | 144.22 | 130.82 | ||
DeepSeek V4 Flash (max) | 1.05M | Open | 40 | $0.06 | 107 | 1.55 | 58.45 | 52.25 | ||
DeepSeek V4 Flash (max) | 1M | Open | 40 | $0.02 | 120 | 1.15 | 52.08 | 46.76 | ||
Qwen3.6 Plus | 1M | Proprietary | 40 | $0.31 | 53 | 2.61 | 117.34 | 105.25 | ||
Qwen3.7 Plus | 1M | Proprietary | 39 | $0.21 | 53 | 2.89 | 49.84 | 37.56 | ||
Agnes 2.5 Pro Alpha | 262k | Proprietary | 39 | -- | 132 | 2.23 | 21.22 | 15.19 | ||
GPT-5.6 Luna (medium) | 1M | Proprietary | 38 | $0.05 | 157 | 3.37 | 6.57 | -- | ||
Nemotron 3 Ultra | 262k | Open | 38 | $0.15 | 219 | 1.15 | 13.80 | 10.37 | ||
Nemotron 3 Ultra | 262k | Open | 38 | -- | -- | -- | -- | -- | ||
Nemotron 3 Ultra | 512k | Open | 38 | -- | 146 | 0.72 | 19.70 | 15.56 | ||
Nemotron 3 Ultra | 262k | Open | 38 | $0.14 | 89 | 5.94 | 37.28 | 25.69 | ||
Nemotron 3 Ultra BF16 | 262k | Open | 38 | -- | -- | -- | -- | -- | ||
Nemotron 3 Ultra | 256k | Open | 38 | $0.54 | 328 | 2.23 | 10.70 | 6.94 | ||
Nemotron 3 Ultra | 262k | Open | 38 | $0.22 | 76 | 1.06 | 37.72 | 30.05 | ||
Nemotron 3 Ultra | 262k | Open | 38 | $0.20 | 433 | 1.12 | 7.52 | 5.25 | ||
DeepSeek V4 Flash (high) | 1M | Open | 37 | $0.07 | 38 | 1.56 | 47.40 | 32.67 | ||
DeepSeek V4 Flash (high) (FP4) | 1.05M | Open | 37 | -- | 35 | 1.08 | 51.40 | 35.86 | ||
DeepSeek V4 Flash (high) | 1.05M | Open | 37 | -- | -- | -- | -- | -- | ||
DeepSeek V4 Flash (high) | 1M | Open | 37 | -- | 178 | 0.86 | 10.65 | 6.98 | ||
DeepSeek V4 Flash (high) (FP8) | 1.05M | Open | 37 | -- | 41 | 2.06 | 44.46 | 30.22 | ||
DeepSeek V4 Flash (high) (FP8) | 1.05M | Open | 37 | $0.05 | 50 | 2.06 | 37.10 | 24.97 | ||
DeepSeek V4 Flash (high) | 1.05M | Open | 37 | $0.04 | 105 | 1.83 | 18.43 | 11.83 | ||
DeepSeek V4 Flash (high) | 1M | Open | 37 | $0.01 | 110 | 1.17 | 17.00 | 11.28 | ||
MiMo-V2.5 | 1.05M | Open | 37 | -- | 67 | 3.55 | 41.10 | 30.04 | ||
MiMo-V2.5 | 1M | Open | 37 | -- | 58 | 1.07 | 44.49 | 34.74 | ||
MiMo-V2.5 | 262k | Open | 37 | -- | 39 | 0.95 | 64.51 | 50.85 | ||
MiMo-V2.5 | 1.05M | Open | 37 | $0.01 | -- | -- | -- | -- | ||
MiMo-V2.5 | 1M | Open | 37 | $0.01 | 67 | 3.27 | 40.34 | 29.66 | ||
Qwen3.6 27B FP8 | 262k | Open | 37 | -- | 55 | 1.30 | 113.54 | 103.15 | ||
Qwen3.6 27B | 131k | Open | 37 | -- | 456 | 1.08 | 14.62 | 12.44 | ||
Qwen3.6 27B | 262k | Open | 37 | $0.27 | 55 | 2.83 | 115.53 | 103.57 | ||
Qwen3.6 27B | 262k | Open | 37 | $0.27 | 54 | 3.64 | 117.04 | 104.21 | ||
Qwen3.6 27B (FP8) | 262k | Open | 37 | $0.17 | 40 | 3.50 | 156.59 | 140.70 | ||
Qwen3.6 27B FP4 | 256k | Open | 37 | -- | 41 | 3.08 | 154.83 | 139.46 | ||
Gemini 3.5 Flash-Lite AI Studio | 1M | Proprietary | 36 | $0.09 | 421 | 9.80 | 10.99 | -- | ||
Grok 4.3 (medium) | 524k | Proprietary | 36* | -- | 198 | 8.67 | 11.19 | -- | ||
Grok 4.3 (medium) | 200k | Proprietary | 36* | -- | 88 | 17.14 | 22.86 | -- | ||
Grok 4.3 (medium) | 1M | Proprietary | 36* | -- | 104 | 14.66 | 19.48 | -- | ||
Grok 4.3 (low) | 524k | Proprietary | 35* | -- | 186 | 4.57 | 7.26 | -- | ||
Grok 4.3 (low) | 200k | Proprietary | 35* | -- | 84 | 7.66 | 13.63 | -- | ||
Grok 4.3 (low) | 1M | Proprietary | 35* | -- | 98 | 7.24 | 12.32 | -- | ||
Gemini 3.5 Flash (minimal) AI Studio | 1M | Proprietary | 35* | -- | 159 | 1.03 | 4.17 | -- | ||
Kimi K2.6 | 262k | Open | 35* | -- | -- | -- | -- | -- | ||
Kimi K2.6 (FP4) | 262k | Open | 35* | -- | 384 | 0.59 | 1.89 | -- | ||
Kimi K2.6 (FP8) | 262k | Open | 35* | -- | 42 | 1.76 | 13.68 | -- | ||
Kimi K2.6 | 262k | Open | 35* | -- | 307 | 0.67 | 2.31 | -- | ||
Kimi K2.6 (INT4) | 262k | Open | 35* | -- | 37 | 1.89 | 15.40 | -- | ||
Kimi K2.6 (FP4) | 262k | Open | 35* | -- | 36 | 0.71 | 14.67 | -- | ||
Kimi K2.6 | 262k | Open | 35* | -- | 245 | 1.16 | 3.20 | -- | ||
Kimi K2.6 | 262k | Open | 35* | -- | 129 | 1.57 | 5.44 | -- | ||
Kimi K2.6 (NVFP4) | 262k | Open | 35* | -- | -- | -- | -- | -- | ||
Kimi K2.6 | 256k | Open | 35* | -- | 32 | 3.06 | 18.58 | -- | ||
Kimi K2.6 | 262k | Open | 35* | -- | 134 | 1.93 | 5.67 | -- | ||
Kimi K2.6 | 262k | Open | 35* | -- | 30 | 3.12 | 19.79 | -- | ||
Claude Sonnet 4.6 (Non-reasoning, Low Effort) | 1M | Proprietary | 34* | -- | 44 | 1.44 | 12.80 | -- | ||
GLM-5.2 (FP4) | 432k | Open | 34 | -- | 321 | 1.06 | 2.62 | -- | ||
GLM-5.2 | 262k | Open | 34 | -- | 76 | 1.62 | 8.19 | -- | ||
GLM-5.2 | 205k | Open | 34 | -- | 183 | 7.04 | 9.77 | -- | ||
GLM-5.2 (FP8) | 1.05M | Open | 34 | -- | 54 | 1.94 | 11.18 | -- | ||
GPT-5.6 Terra (Non-reasoning) | 1M | Proprietary | 34 | $0.18 | 117 | 0.74 | 5.00 | -- | ||
KAT-Coder-Pro V2 | 256k | Proprietary | 34 | -- | 99 | 1.54 | 6.61 | -- | ||
KAT-Coder-Pro V2 | 256k | Proprietary | 34 | -- | -- | -- | -- | -- | ||
Qwen3.5 397B A17B | 256k | Open | 34 | $0.33 | -- | -- | -- | -- | ||
Qwen3.5 397B A17B | 262k | Open | 34 | $0.33 | 68 | 2.33 | 56.55 | 46.87 | ||
Qwen3.5 397B A17B | 262k | Open | 34 | $0.24 | 65 | 2.24 | 59.37 | 49.38 | ||
Qwen3.5 397B A17B | 262k | Open | 34 | $0.23 | 78 | 1.04 | 48.38 | 40.91 | ||
Qwen3.5 397B A17B (FP8) | 262k | Open | 34 | $0.22 | 85 | 2.50 | 45.84 | 37.45 | ||
Qwen3.5 397B A17B (FP8) | 262k | Open | 34 | $0.18 | 45 | 1.21 | 83.51 | 71.14 | ||
Qwen3.5 397B A17B | 262k | Open | 34 | -- | 11 | 1.16 | 343.81 | 296.17 | ||
Qwen3.5 397B A17B (FP8) | 262k | Open | 34 | $0.33 | -- | -- | -- | -- | ||
Qwen3.5 397B A17B (Base, FP4) | 262k | Open | 34 | $0.33 | 91 | 1.97 | 42.46 | 35.00 | ||
Qwen3.5 397B A17B | 262k | Open | 34 | $0.33 | 67 | 1.80 | 56.91 | 47.64 | ||
Hy3-preview | 262k | Open | 34* | -- | -- | -- | -- | -- | ||
Hy3-preview | 256k | Open | 34* | -- | 120 | 2.98 | 23.74 | 16.61 | ||
GPT-5.6 Luna (low) | 1M | Proprietary | 33 | $0.04 | 156 | 1.64 | 4.85 | -- | ||
Qwen3.5 122B A10B (FP8) | 262k | Open | 32 | $0.16 | 43 | 2.11 | 60.62 | 46.82 | ||
Qwen3.5 122B A10B (FP4) | 262k | Open | 32 | $0.11 | 53 | 5.90 | 53.47 | 38.06 | ||
Qwen3.5 122B A10B | 262k | Open | 32 | $0.24 | 132 | 2.35 | 21.22 | 15.10 | ||
Qwen3.5 122B A10B (FP8) | 262k | Open | 32 | $0.24 | -- | -- | -- | -- | ||
Qwen3.5 122B A10B | 262k | Open | 32 | $0.24 | 93 | 1.95 | 28.81 | 21.49 | ||
Qwen3.5 397B A17B | 262k | Open | 32* | -- | 64 | 2.09 | 9.94 | -- | ||
Qwen3.5 397B A17B (FP8) | 262k | Open | 32* | -- | 38 | 1.18 | 14.23 | -- | ||
Qwen3.5 397B A17B | 262k | Open | 32* | -- | 62 | 2.17 | 10.26 | -- | ||
Qwen3.5 397B A17B (Base, FP4) | 262k | Open | 32* | -- | 97 | 1.95 | 7.13 | -- | ||
Qwen3.5 397B A17B | 262k | Open | 32* | -- | 10 | 166.34 | 214.76 | -- | ||
Qwen3.5 397B A17B | 262k | Open | 32* | -- | 63 | 1.80 | 9.79 | -- | ||
Qwen3.6 35B A3B | 229k | Open | 32 | $0.18 | 156 | 2.23 | 40.03 | 34.60 | ||
Qwen3.6 35B A3B (FP8) | 262k | Open | 32 | $0.16 | 45 | 2.17 | 131.87 | 118.70 | ||
Qwen3.6 35B A3B | 262k | Open | 32 | -- | 139 | 0.94 | 43.36 | 38.82 | ||
Qwen3.6 35B A3B (FP8) | 262k | Open | 32 | $0.11 | 33 | 0.70 | 178.08 | 162.34 | ||
Qwen3.6 35B A3B FP4 | 1M | Open | 32 | $0.11 | 39 | 1.30 | 152.10 | 138.01 | ||
Qwen3.6 35B A3B (FP8) | 262k | Open | 32 | -- | -- | -- | -- | -- | ||
Qwen3.6 35B A3B FP8 | 262k | Open | 32 | $0.18 | -- | -- | -- | -- | ||
Qwen3.6 35B A3B | 262k | Open | 32 | $0.19 | 91 | 1.02 | 65.90 | 59.38 | ||
Qwen3.6 35B A3B | 205k | Open | 32 | $0.18 | 150 | 1.62 | 40.84 | 35.89 | ||
DeepSeek V4 Pro | 1M | Open | 31* | -- | 78 | 1.76 | 8.20 | -- | ||
DeepSeek V4 Pro | 1.05M | Open | 31* | -- | 52 | 2.19 | 11.88 | -- | ||
DeepSeek V4 Pro | 1M | Open | 31* | -- | 142 | 0.84 | 4.37 | -- | ||
DeepSeek V4 Pro | 1M | Open | 31* | -- | 66 | 1.48 | 9.04 | -- | ||
Qwen3.5 Omni Plus | 256k | Proprietary | 31* | -- | 48 | 2.50 | 12.83 | -- | ||
Ring-2.6-1T | 262k | Open | 31 | $0.35 | 122 | 3.19 | 23.60 | 16.33 | ||
Qwen3.6 27B | 131k | Open | 30 | -- | 460 | 1.03 | 2.11 | -- | ||
Qwen3.6 27B FP4 | 256k | Open | 30 | -- | 43 | 3.12 | 14.86 | -- | ||
Qwen3.6 27B FP8 | 262k | Open | 30 | -- | 44 | 1.23 | 12.72 | -- | ||
Qwen3.6 27B | 262k | Open | 30 | $0.36 | 56 | 3.88 | 12.87 | -- | ||
Qwen3.6 27B | 262k | Open | 30 | $0.36 | 58 | 78.03 | 86.72 | -- | ||
o3 | 200k | Proprietary | 30* | -- | 107 | 34.25 | 38.90 | -- | ||
o3 | 200k | Proprietary | 30* | -- | -- | -- | -- | -- | ||
o3 | 200k | Proprietary | 30* | -- | 139 | 5.88 | 9.49 | -- | ||
Step 3.7 Flash | 256k | Open | 30 | -- | 392 | 0.87 | 7.24 | 5.10 | ||
Step 3.7 Flash | 256k | Open | 30 | -- | 170 | 0.52 | 15.24 | 11.78 | ||
Mistral Medium 3.5 | 262k | Open | 30 | $0.56 | 95 | 2.12 | 28.36 | 20.99 | ||
Claude 4.5 Haiku | 200k | Proprietary | 30 | $0.25 | 115 | 11.35 | 15.70 | -- | ||
Claude 4.5 Haiku Vertex | 200k | Proprietary | 30 | $0.23 | 99 | 13.09 | 18.13 | -- | ||
Claude 4.5 Haiku | 200k | Proprietary | 30 | $0.24 | 98 | 11.59 | 16.67 | -- | ||
Claude 4.5 Haiku | 200k | Proprietary | 30 | $0.51 | 101 | 18.31 | 23.26 | -- | ||
Gemma 4 31B | 262k | Open | 29 | -- | 34 | 1.08 | 66.30 | 50.64 | ||
Gemma 4 31B (FP8) | 262k | Open | 29 | -- | -- | -- | -- | -- | ||
Gemma 4 31B | 262k | Open | 29 | -- | -- | -- | -- | -- | ||
Gemma 4 31B | 131k | Open | 29 | $0.21 | 1,662 | 0.65 | 2.00 | 1.04 | ||
Gemma 4 31B (AI Studio) | 262k | Open | 29 | -- | 35 | 1.03 | 64.41 | 49.20 | ||
Gemma 4 31B | 262k | Open | 29 | $0.02 | 50 | 3.41 | 48.35 | 34.89 | ||
Gemma 4 31B | 262k | Open | 29 | $0.01 | 17 | 1.41 | 130.81 | 100.46 | ||
Gemma 4 31B (FP8) | 262k | Open | 29 | -- | 64 | 3.35 | 38.16 | 27.02 | ||
Gemma 4 31B | 131k | Open | 29 | -- | 194 | 2.60 | 14.11 | 8.94 | ||
Gemma 4 31B | 256k | Open | 29 | -- | 149 | 1.50 | 16.49 | 11.64 | ||
Gemma 4 31B | 131k | Open | 29 | -- | 148 | 0.61 | 15.73 | 11.73 | ||
Gemma 4 31B (FP8) | 262k | Open | 29 | -- | 53 | 1.50 | 43.76 | 32.81 | ||
GPT-5.5 Instant (June 2026) | 400k | Proprietary | 29 | $0.54 | -- | -- | -- | -- | ||
DeepSeek V4 Flash | 1M | Open | 29* | -- | 111 | 1.25 | 5.76 | -- | ||
DeepSeek V4 Flash | 1.05M | Open | 29* | -- | -- | -- | -- | -- | ||
DeepSeek V4 Flash | 1M | Open | 29* | -- | 188 | 0.78 | 3.43 | -- | ||
DeepSeek V4 Flash | 1M | Open | 29* | -- | 33 | 1.47 | 16.40 | -- | ||
MiMo-V2.5-Pro | 1.05M | Open | 28* | -- | -- | -- | -- | -- | ||
MiMo-V2.5-Pro | 65.5k | Open | 28* | -- | 76 | 0.92 | 7.46 | -- | ||
MiMo-V2.5-Pro | 131k | Open | 28* | -- | 66 | 2.80 | 10.35 | -- | ||
MiMo-V2.5-Pro | 1.05M | Open | 28* | -- | 65 | 2.11 | 9.82 | -- | ||
Qwen3.5 122B A10B (FP4) | 262k | Open | 28 | $0.09 | 55 | 5.85 | 14.94 | -- | ||
Qwen3.5 122B A10B | 262k | Open | 28 | $0.18 | 144 | 2.35 | 5.81 | -- | ||
GPT-5.6 Luna (Non-reasoning) | 1M | Proprietary | 27 | $0.05 | 161 | 0.68 | 3.79 | -- | ||
Hy3-preview | 262k | Open | 26* | -- | -- | -- | -- | -- | ||
Hy3-preview | 328k | Open | 26* | -- | 121 | 3.16 | 7.29 | -- | ||
Ling-2.6-1T | 262k | Open | 26* | -- | -- | -- | -- | -- | ||
Step 3.5 Flash 2603 | 256k | Proprietary | 26* | -- | 302 | 1.07 | 9.35 | 6.63 | ||
Gemini 2.5 Pro Vertex | 1M | Proprietary | 26 | $0.20 | 107 | 31.87 | 36.53 | -- | ||
Gemini 2.5 Pro (AI Studio) | 1M | Proprietary | 26 | $0.20 | 132 | 21.98 | 25.77 | -- | ||
Gemma 4 26B A4B | 1M | Open | 26 | -- | 156 | 1.01 | 17.04 | 12.82 | ||
Gemma 4 26B A4B | 262k | Open | 26 | $0.04 | 26 | 1.96 | 98.96 | 77.60 | ||
Gemma 4 26B A4B AI Studio | 262k | Open | 26 | -- | 47 | 1.11 | 54.37 | 42.61 | ||
Gemma 4 26B A4B | 256k | Open | 26 | -- | 82 | 1.49 | 31.94 | 24.36 | ||
Gemma 4 26B A4B | 262k | Open | 26 | $0.02 | 22 | 0.80 | 112.57 | 89.41 | ||
Gemma 4 26B A4B | 256k | Open | 26 | $0.02 | 56 | 1.38 | 45.89 | 35.61 | ||
Gemma 4 26B A4B | 256k | Open | 26 | -- | -- | -- | -- | -- | ||
Gemma 4 26B A4B (FP8) | 1.05M | Open | 26 | $0.04 | -- | -- | -- | -- | ||
NVIDIA Nemotron 3 Super | 203k | Open | 25 | -- | -- | -- | -- | -- | ||
NVIDIA Nemotron 3 Super | 262k | Open | 25 | $0.20 | 141 | 0.97 | 18.68 | 14.17 | ||
NVIDIA Nemotron 3 Super | 256k | Open | 25 | $0.29 | 343 | 1.75 | 9.05 | 5.84 | ||
NVIDIA Nemotron 3 Super | 262k | Open | 25 | -- | -- | -- | -- | -- | ||
Gemini 3.1 Flash-Lite (AI Studio) | 1M | Proprietary | 25 | $0.04 | 289 | 6.25 | 7.97 | -- | ||
Grok 4.3 (Non-reasoning) | 524k | Proprietary | 25 | $0.99 | 182 | 0.98 | 3.73 | -- | ||
Grok 4.3 (Non-reasoning) | 1M | Proprietary | 25 | $0.29 | 97 | 1.19 | 6.33 | -- | ||
Qwen3.6 35B A3B (FP8) | 262k | Open | 24 | -- | -- | -- | -- | -- | ||
Qwen3.6 35B A3B | 262k | Open | 24 | -- | 139 | 0.94 | 4.53 | -- | ||
Qwen3.6 35B A3B FP4 | 1M | Open | 24 | $0.24 | 47 | 36.03 | 46.74 | -- | ||
Qwen3.6 35B A3B (FP8) | 262k | Open | 24 | $0.30 | 31 | 0.90 | 17.08 | -- | ||
Qwen3.6 35B A3B | 205k | Open | 24 | $0.40 | 171 | 1.63 | 4.56 | -- | ||
Qwen3.6 35B A3B FP8 | 262k | Open | 24 | $0.40 | -- | -- | -- | -- | ||
Qwen3.6 35B A3B (FP8) | 262k | Open | 24 | $0.41 | 114 | 1.29 | 5.66 | -- | ||
Qwen3.6 35B A3B | 262k | Open | 24 | $0.60 | 177 | 2.30 | 5.13 | -- | ||
Qwen3.5 35B A3B FP8 | 262k | Open | 24 | $0.07 | 147 | 0.47 | 3.86 | -- | ||
Qwen3.5 35B A3B | 262k | Open | 24 | $0.23 | 140 | 2.25 | 5.81 | -- | ||
gpt-oss-120b (high) | 131k | Open | 24 | $0.05 | 478 | 0.73 | 5.97 | 4.19 | ||
gpt-oss-120b (high) | 116k | Open | 24 | -- | 126 | 0.97 | 20.87 | 15.92 | ||
gpt-oss-120b (high) | 128k | Open | 24 | $0.07 | 151 | 1.24 | 17.75 | 13.21 | ||
gpt-oss-120b (high) | 131k | Open | 24 | $0.02 | 50 | 0.57 | 50.47 | 39.92 | ||
gpt-oss-120b (high) | 131k | Open | 24 | -- | 76 | 1.40 | 34.43 | 26.42 | ||
gpt-oss-120b (high) | 131k | Open | 24 | $0.06 | 339 | 0.87 | 8.24 | 5.89 | ||
gpt-oss-120b (high) | 131k | Open | 24 | $0.02 | 68 | 0.98 | 37.81 | 29.46 | ||
gpt-oss-120b (high) (Turbo) | 131k | Open | 24 | -- | 287 | 0.64 | 9.34 | 6.96 | ||
gpt-oss-120b (high) | 128k | Open | 24 | -- | 130 | 0.93 | 20.16 | 15.39 | ||
gpt-oss-120b (high) | 131k | Open | 24 | $0.12 | 1,970 | 0.50 | 1.77 | 1.02 | ||
gpt-oss-120b (high) Vertex | 131k | Open | 24 | -- | 398 | 0.46 | 6.73 | 5.02 | ||
gpt-oss-120b (high) | 131k | Open | 24 | -- | -- | -- | -- | -- | ||
gpt-oss-120b (high) | 128k | Open | 24 | $0.04 | 216 | 0.29 | 11.85 | 9.25 | ||
gpt-oss-120b (high) | 131k | Open | 24 | -- | 707 | 0.99 | 4.53 | 2.83 | ||
gpt-oss-120b (high) | 131k | Open | 24 | -- | 203 | 0.83 | 13.16 | 9.86 | ||
gpt-oss-120b (high) | 131k | Open | 24 | $0.02 | -- | -- | -- | -- | ||
gpt-oss-120b (high) | 131k | Open | 24 | -- | 704 | 2.57 | 6.12 | 2.84 | ||
gpt-oss-120b (high) (Base) | 128k | Open | 24 | -- | 310 | 1.00 | 9.06 | 6.45 | ||
gpt-oss-120b (high) | 131k | Open | 24 | -- | -- | -- | -- | -- | ||
gpt-oss-120b (high) | 128k | Open | 24 | $0.06 | 318 | 0.70 | 8.57 | 6.29 | ||
gpt-oss-120b (high) | 131k | Open | 24 | $0.06 | 85 | 1.14 | 30.47 | 23.47 | ||
gpt-oss-120b (high) | 131k | Open | 24 | -- | 573 | 0.56 | 4.93 | 3.49 | ||
Claude 4.5 Haiku | 200k | Proprietary | 24* | -- | 92 | 1.34 | 6.78 | -- | ||
Claude 4.5 Haiku | 200k | Proprietary | 24* | -- | 105 | 1.01 | 5.78 | -- | ||
Claude 4.5 Haiku | 200k | Proprietary | 24* | -- | 90 | 0.92 | 6.45 | -- | ||
Claude 4.5 Haiku Vertex | 200k | Proprietary | 24* | -- | 91 | 0.59 | 6.09 | -- | ||
Command A+ | 200k | Open | 23 | $0.00 | 192 | 0.41 | 13.41 | 10.40 | ||
Gemma 4 12B | 262k | Open | 22 | -- | 106 | 2.35 | 26.01 | 18.93 | ||
Gemma 4 31B | 262k | Open | 22 | $0.03 | 43 | 2.67 | 14.28 | -- | ||
Gemma 4 31B | 131k | Open | 22 | $0.24 | 1,609 | 0.72 | 1.03 | -- | ||
Gemma 4 31B | 262k | Open | 22 | -- | 145 | 1.26 | 4.72 | -- | ||
Gemma 4 31B (FP8) | 262k | Open | 22 | -- | 60 | 1.16 | 9.53 | -- | ||
Gemma 4 31B (FP8) | 262k | Open | 22 | -- | 58 | 2.97 | 11.65 | -- | ||
Gemma 4 31B (FP8) | 262k | Open | 22 | $0.03 | 13 | 1.04 | 39.08 | -- | ||
Gemma 4 31B | 131k | Open | 22 | -- | 200 | 2.59 | 5.09 | -- | ||
Gemma 4 31B | 262k | Open | 22 | -- | 13 | 1.43 | 40.35 | -- | ||
Nova 2.0 Pro Preview (medium) | 256k | Proprietary | 22 | $0.17 | 118 | 13.71 | 34.95 | 16.99 | ||
Qwen3.5 9B (FP8) | 262k | Open | 21 | $0.16 | 51 | 2.58 | 51.41 | 39.07 | ||
Qwen3.5 9B (FP8) | 262k | Open | 21 | $0.28 | 53 | 0.85 | 47.62 | 37.42 | ||
Mercury 2 | 128k | Proprietary | 21 | $0.08 | 939 | 3.73 | 4.26 | -- | ||
Qwen3 Coder Next | 128k | Open | 21 | $0.46 | 128 | 1.64 | 5.54 | -- | ||
Qwen3 Coder Next (FP8) | 262k | Open | 21 | $0.11 | 90 | 1.04 | 6.61 | -- | ||
Qwen3 Coder Next (FP8) | 262k | Open | 21 | -- | -- | -- | -- | -- | ||
Qwen3 Coder Next (FP8) | 262k | Open | 21 | $0.20 | 173 | 2.87 | 5.76 | -- | ||
Nova 2.0 Omni (medium) | 1M | Proprietary | 21* | -- | -- | -- | -- | -- | ||
Nova 2.0 Omni (medium) | 1M | Proprietary | 21* | -- | -- | -- | -- | -- | ||
Apriel-v1.6-15B-Thinker | 131k | Open | 21* | -- | -- | -- | -- | -- | ||
Gemma 4 26B A4B | 1M | Open | 20* | -- | 151 | 1.01 | 4.32 | -- | ||
Gemma 4 26B A4B | 262k | Open | 20* | -- | 51 | 2.01 | 11.82 | -- | ||
Gemma 4 26B A4B (FP8) | 1.05M | Open | 20* | -- | -- | -- | -- | -- | ||
Gemma 4 26B A4B (FP8) | 262k | Open | 20* | -- | 67 | 2.21 | 9.62 | -- | ||
Gemma 4 26B A4B | 256k | Open | 20* | -- | -- | -- | -- | -- | ||
Gemma 4 26B A4B | 262k | Open | 20* | -- | 140 | 0.92 | 4.49 | -- | ||
Gemma 4 26B A4B (FP8) | 262k | Open | 20* | -- | 24 | 0.70 | 21.74 | -- | ||
Gemma 4 26B A4B | 262k | Open | 20* | -- | 28 | 3.20 | 20.95 | -- | ||
Qwen3.5 4B (FP8) | 262k | Open | 20* | -- | 30 | 0.81 | 83.43 | 66.10 | ||
North Mini Code | 256k | Open | 20 | $0.00 | 64 | 0.74 | 39.72 | 31.18 | ||
Nova 2.0 Pro Preview (low) | 256k | Proprietary | 20 | $0.21 | 119 | 11.61 | 32.55 | 16.76 | ||
Mistral Small 4 | 256k | Open | 20 | $0.10 | 156 | 0.79 | 16.80 | 12.81 | ||
Devstral 2 | 262k | Open | 19 | $0.00 | 22 | 1.28 | 24.22 | -- | ||
Nova 2.0 Lite (medium) | 1M | Proprietary | 19* | -- | 152 | 18.20 | 34.69 | 13.20 | ||
Qwen3.5 Omni Flash | 256k | Proprietary | 19* | -- | 231 | 1.81 | 3.97 | -- | ||
Nova 2.0 Lite (high) | 1M | Proprietary | 18 | -- | -- | -- | -- | -- | ||
Nova 2.0 Lite (high) | 1M | Proprietary | 18 | $0.25 | 149 | 20.92 | 37.69 | 13.42 | ||
Trinity Large Thinking | 262k | Open | 18 | -- | -- | -- | -- | -- | ||
Trinity Large Thinking (FP8) | 262k | Open | 18 | $0.07 | 173 | 0.89 | 15.36 | 11.57 | ||
Magistral Medium 1.2 | 131k | Proprietary | 18 | $0.75 | 44 | 1.74 | 58.51 | 45.41 | ||
Nova 2.0 Lite (low) | 1M | Proprietary | 18* | -- | 149 | 9.51 | 26.30 | 13.43 | ||
HyperNova 60B 2605 | 131k | Open | 18 | $0.02 | 436 | 0.62 | 6.35 | 4.59 | ||
Devstral Small 2 | 256k | Open | 17 | $0.00 | 25 | 1.35 | 21.51 | -- | ||
Qwen3 Next 80B A3B | 262k | Open | 17 | $0.04 | -- | -- | -- | -- | ||
Qwen3 Next 80B A3B Vertex | 262k | Open | 17 | -- | 129 | 0.84 | 20.17 | 15.47 | ||
Qwen3 Next 80B A3B | 262k | Open | 17 | $0.17 | 179 | 2.13 | 16.14 | 11.20 | ||
Qwen3 Next 80B A3B (FP8) | 262k | Open | 17 | $0.04 | 98 | 1.08 | 26.69 | 20.49 | ||
Qwen3 Next 80B A3B | 262k | Open | 17 | -- | -- | -- | -- | -- | ||
Nova 2.0 Omni (low) | 1M | Proprietary | 17* | -- | -- | -- | -- | -- | ||
G9v3-3B | 131k | Open | 16 | -- | -- | -- | -- | -- | ||
Qwen3.5 4B FP8 | 262k | Open | 16* | -- | 30 | 0.90 | 17.42 | -- | ||
Mistral Large 3 | 256k | Open | 16 | $0.06 | 203 | 1.27 | 3.74 | -- | ||
Mistral Large 3 | 256k | Open | 16 | -- | 72 | 1.54 | 8.53 | -- | ||
Mistral Large 3 | 262k | Open | 16 | $0.06 | 49 | 1.18 | 11.38 | -- | ||
Nemotron 3 Nano Omni 30B A3B Reasoning | 262k | Open | 15* | -- | -- | -- | -- | -- | ||
Nemotron 3 Nano Omni 30B A3B Reasoning (FP8) | 65.5k | Open | 15* | -- | 306 | 1.01 | 9.17 | 6.53 | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | -- | -- | -- | -- | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | -- | -- | -- | -- | ||
gpt-oss-120b (low) Base | 128k | Open | 15 | -- | 308 | 0.98 | 9.10 | 6.49 | ||
gpt-oss-120b (low) | 128k | Open | 15 | -- | 129 | 0.96 | 20.35 | 15.52 | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | 739 | 1.03 | 4.42 | 2.71 | ||
gpt-oss-120b (low) Vertex | 131k | Open | 15 | -- | 415 | 0.46 | 6.48 | 4.82 | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | 624 | 1.96 | 5.97 | 3.21 | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | 85 | 1.37 | 30.64 | 23.42 | ||
gpt-oss-120b (low) | 131k | Open | 15 | $0.04 | 1,794 | 0.52 | 1.91 | 1.11 | ||
gpt-oss-120b (low) | 131k | Open | 15 | $0.02 | 360 | 0.83 | 7.77 | 5.55 | ||
gpt-oss-120b (low) | 128k | Open | 15 | -- | 116 | 1.01 | 22.50 | 17.20 | ||
gpt-oss-120b (low) | 131k | Open | 15 | $0.01 | -- | -- | -- | -- | ||
gpt-oss-120b (low) | 128k | Open | 15 | $0.01 | 224 | 0.34 | 11.50 | 8.93 | ||
gpt-oss-120b (low) | 131k | Open | 15 | $0.02 | 124 | 1.21 | 21.42 | 16.17 | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | 198 | 0.82 | 13.45 | 10.10 | ||
gpt-oss-120b (low) | 128k | Open | 15 | $0.02 | 315 | 0.67 | 8.61 | 6.36 | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | 563 | 0.54 | 4.98 | 3.55 | ||
gpt-oss-120b (low) | 131k | Open | 15 | $0.02 | 473 | 0.77 | 6.05 | 4.22 | ||
gpt-oss-120b (low) | 131k | Open | 15 | -- | -- | -- | -- | -- | ||
gpt-oss-120b (low) | 131k | Open | 15 | $0.01 | 73 | 0.98 | 35.00 | 27.22 | ||
gpt-oss-20b (high) | 131k | Open | 15 | -- | 205 | 0.93 | 13.10 | 9.74 | ||
gpt-oss-20b (high) | 131k | Open | 15 | -- | 127 | 33.89 | 53.53 | 15.72 | ||
gpt-oss-20b (high) | 131k | Open | 15 | -- | 112 | 0.45 | 22.74 | 17.83 | ||
gpt-oss-20b (high) | 131k | Open | 15 | -- | 422 | 0.35 | 6.28 | 4.74 | ||
gpt-oss-20b (high) | 131k | Open | 15 | -- | -- | -- | -- | -- | ||
gpt-oss-20b (high) | 128k | Open | 15 | -- | 274 | 0.49 | 9.62 | 7.30 | ||
gpt-oss-20b (high) | 128k | Open | 15 | -- | 161 | 0.77 | 16.34 | 12.45 | ||
gpt-oss-20b (high) | 131k | Open | 15 | -- | 151 | 1.12 | 17.64 | 13.22 | ||
gpt-oss-20b (high) Vertex | 131k | Open | 15 | -- | 305 | 1.12 | 9.31 | 6.55 | ||
gpt-oss-20b (high) | 131k | Open | 15 | $0.03 | 304 | 1.13 | 9.37 | 6.59 | ||
gpt-oss-20b (high) | 131k | Open | 15 | -- | 814 | 0.83 | 3.90 | 2.46 | ||
gpt-oss-20b (high) | 131k | Open | 15 | $0.02 | -- | -- | -- | -- | ||
Nova 2.0 Pro Preview | 256k | Proprietary | 14 | $0.25 | 107 | 1.01 | 5.66 | -- | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | 415 | 0.36 | 6.39 | 4.82 | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | -- | -- | -- | -- | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | 890 | 0.80 | 3.61 | 2.25 | ||
gpt-oss-20b (low) | 128k | Open | 14* | -- | 273 | 0.51 | 9.66 | 7.32 | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | -- | -- | -- | -- | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | 215 | 0.94 | 12.58 | 9.31 | ||
gpt-oss-20b (low) | 128k | Open | 14* | -- | 161 | 0.75 | 16.27 | 12.41 | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | 222 | 7.05 | 18.29 | 8.99 | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | 143 | 1.08 | 18.58 | 14.00 | ||
gpt-oss-20b (low) | 131k | Open | 14* | -- | 248 | 0.81 | 10.88 | 8.05 | ||
gpt-oss-20b (low) Vertex | 131k | Open | 14* | -- | 275 | 0.82 | 9.92 | 7.28 | ||
Llama 4 Maverick (FP8) | 1.05M | Open | 14 | $0.03 | 47 | 0.90 | 11.46 | -- | ||
Llama 4 Maverick (FP8) | 128k | Open | 14 | $0.03 | 117 | 1.23 | 5.50 | -- | ||
Llama 4 Maverick | 128k | Open | 14 | -- | 208 | 0.87 | 3.28 | -- | ||
Llama 4 Maverick | 131k | Open | 14 | -- | 124 | 1.09 | 5.13 | -- | ||
Llama 4 Maverick | 1.05M | Open | 14 | -- | -- | -- | -- | -- | ||
Llama 4 Maverick (FP8) | 1.05M | Open | 14 | -- | 40 | 0.64 | 12.99 | -- | ||
Llama 4 Maverick | 131k | Open | 14 | $0.05 | 86 | 0.97 | 6.79 | -- | ||
Llama 4 Maverick (FP8) | 1.05M | Open | 14 | $0.02 | 120 | 0.95 | 5.12 | -- | ||
NVIDIA Nemotron 3 Nano | 262k | Open | 14 | $0.02 | 128 | 1.07 | 20.57 | 15.60 | ||
NVIDIA Nemotron 3 Nano (FP4) | 262k | Open | 14 | -- | 223 | 1.06 | 12.29 | 8.98 | ||
NVIDIA Nemotron 3 Nano | 262k | Open | 14 | $0.02 | 74 | 10.93 | 44.61 | 26.95 | ||
Ling 2.6 Flash | 262k | Open | 14 | -- | 133 | 1.14 | 4.90 | -- | ||
Qwen3 Next 80B A3B | 262k | Open | 14* | -- | -- | -- | -- | -- | ||
Qwen3 Next 80B A3B Vertex | 262k | Open | 14* | -- | 189 | 0.77 | 3.42 | -- | ||
Qwen3 Next 80B A3B | 262k | Open | 14* | -- | 178 | 2.24 | 5.05 | -- | ||
Qwen3 Next 80B A3B | 262k | Open | 14* | -- | 119 | 0.66 | 4.84 | -- | ||
Qwen3 Next 80B A3B | 262k | Open | 14* | -- | 128 | 0.91 | 4.82 | -- | ||
Qwen3 Next 80B A3B | 131k | Open | 14* | -- | 186 | 1.63 | 4.31 | -- | ||
Qwen3 Next 80B A3B | 131k | Open | 14* | -- | 181 | 2.20 | 4.97 | -- | ||
Gemma 4 12B (Non-reasoning) | 262k | Open | 13* | -- | 106 | 2.46 | 7.17 | -- | ||
Nova Premier | 1M | Proprietary | 13* | -- | 32 | 2.89 | 18.39 | -- | ||
Llama Nemotron Super 49B v1.5 | 131k | Open | 12* | -- | 65 | 6.18 | 44.70 | 30.82 | ||
Mistral Small 4 | 262k | Open | 12* | -- | 145 | 0.74 | 4.18 | -- | ||
Sarvam 105B (high) | 128k | Open | 12* | -- | -- | -- | -- | -- | ||
Gemma 4 E4B | 262k | Open | 12 | -- | 92 | 0.83 | 27.98 | 21.72 | ||
Nova 2.0 Lite | 1M | Proprietary | 12* | -- | 154 | 1.10 | 4.34 | -- | ||
Magistral Small 1.2 | 128k | Open | 11 | -- | 73 | 1.61 | 35.83 | 27.38 | ||
Magistral Small 1.2 | 131k | Open | 11 | $0.25 | 88 | 0.97 | 29.40 | 22.74 | ||
Ministral 3 14B | 262k | Open | 11 | $0.15 | 71 | 0.87 | 7.93 | -- | ||
Ministral 3 14B | 256k | Open | 11 | $0.15 | 219 | 1.01 | 3.29 | -- | ||
Nova 2.0 Omni | 1M | Proprietary | 11* | -- | -- | -- | -- | -- | ||
Llama 4 Scout | 328k | Open | 10 | $0.0049 | 54 | 0.56 | 9.85 | -- | ||
Llama 4 Scout | 128k | Open | 10 | -- | -- | -- | -- | -- | ||
Llama 4 Scout Vertex | 1.31M | Open | 10 | $0.01 | 144 | 0.81 | 4.28 | -- | ||
Llama 4 Scout | 131k | Open | 10 | $0.01 | 73 | 0.74 | 7.57 | -- | ||
Llama 4 Scout | 128k | Open | 10 | -- | 169 | 0.87 | 3.82 | -- | ||
Llama 4 Scout | 131k | Open | 10 | $0.01 | 52 | 0.84 | 10.40 | -- | ||
Llama 4 Scout | 131k | Open | 10 | $0.01 | 445 | 0.71 | 1.83 | -- | ||
Hermes 4 70B (FP8) | 128k | Open | 10* | -- | 95 | 1.37 | 27.76 | 21.11 | ||
Qwen3 Omni 30B A3B | 65.5k | Open | 10* | -- | 99 | 1.94 | 27.16 | 20.18 | ||
Llama 3.3 70B | 131k | Open | 9 | -- | -- | -- | -- | -- | ||
Llama 3.3 70B Vertex | 128k | Open | 9 | $0.10 | 148 | 0.65 | 4.03 | -- | ||
Llama 3.3 70B | 131k | Open | 9 | $0.08 | 291 | 0.99 | 2.71 | -- | ||
Llama 3.3 70B | 131k | Open | 9 | $0.02 | -- | -- | -- | -- | ||
Llama 3.3 70B (FP8) | 131k | Open | 9 | $0.02 | 54 | 2.46 | 11.65 | -- | ||
Llama 3.3 70B | 128k | Open | 9 | $0.08 | 281 | 1.90 | 3.68 | -- | ||
Llama 3.3 70B | 8k | Open | 9 | -- | -- | -- | -- | -- | ||
Llama 3.3 70B Base | 128k | Open | 9 | -- | 20 | 3.41 | 28.01 | -- | ||
Llama 3.3 70B FP8 | 128k | Open | 9 | -- | -- | -- | -- | -- | ||
Llama 3.3 70B | 128k | Open | 9 | -- | 78 | 0.92 | 7.31 | -- | ||
Llama 3.3 70B Turbo | 131k | Open | 9 | $0.14 | 71 | 1.42 | 8.48 | -- | ||
Llama 3.3 70B | 128k | Open | 9 | $0.10 | 98 | 2.26 | 7.33 | -- | ||
Llama 3.3 70B (Turbo, FP8) | 131k | Open | 9 | $0.01 | 11 | 2.31 | 47.69 | -- | ||
Llama 3.3 70B | 24k | Open | 9 | $0.04 | 37 | 3.91 | 17.51 | -- | ||
Llama 3.3 70B | 128k | Open | 9 | $0.10 | 120 | 1.20 | 5.38 | -- | ||
Llama 3.3 70B | 128k | Open | 9 | $0.07 | 64 | 1.29 | 9.05 | -- | ||
Llama 3.3 70B | 100k | Open | 9 | $0.14 | 83 | 1.40 | 7.43 | -- | ||
Llama Nemotron Ultra Base | 131k | Open | 9* | -- | 53 | 2.34 | 49.85 | 38.01 | ||
ERNIE 4.5 300B A47B | 131k | Open | 9* | -- | -- | -- | -- | -- | ||
Hermes 4 405B (FP8) | 128k | Open | 9* | -- | 36 | 2.41 | 72.07 | 55.73 | ||
NVIDIA Nemotron Nano 12B v2 VL (FP8) | 131k | Open | 9* | -- | 66 | 10.67 | 48.31 | 30.12 | ||
Ministral 3 8B | 256k | Open | 9 | $0.18 | 249 | 1.04 | 3.05 | -- | ||
Ministral 3 8B | 262k | Open | 9 | $0.18 | 118 | 0.73 | 4.95 | -- | ||
Gemma 4 E4B | 262k | Open | 9* | -- | 91 | 0.78 | 6.26 | -- | ||
NVIDIA Nemotron Nano 9B V2 | 131k | Open | 9* | -- | 83 | 9.66 | 39.80 | 24.11 | ||
Hermes 4 405B (FP8) | 128k | Open | 9* | -- | 36 | 2.38 | 16.39 | -- | ||
Llama Nemotron Super 49B v1.5 | 131k | Open | 9* | -- | 71 | 9.29 | 16.32 | -- | ||
Llama 3.1 405B | 128k | Open | 9* | -- | -- | -- | -- | -- | ||
LFM2.5-8B-A1B | 32.8k | Open | 8* | -- | 334 | 2.15 | 9.65 | 5.99 | ||
Ring-flash-2.0 | 131k | Open | 8* | -- | -- | -- | -- | -- | ||
Olmo 3.1 32B Think | 65.5k | Open | 8* | -- | -- | -- | -- | -- | ||
Command A | 288k | Open | 8* | -- | 55 | 1.64 | 10.79 | -- | ||
Command A | 256k | Open | 8* | -- | 41 | 3.09 | 15.41 | -- | ||
Llama 3.1 Nemotron 70B | 131k | Open | 8* | -- | 84 | 6.65 | 12.63 | -- | ||
NVIDIA Nemotron 3 Nano (FP4) | 262k | Open | 7* | -- | 197 | 1.10 | 3.64 | -- | ||
NVIDIA Nemotron 3 Nano | 262k | Open | 7* | -- | 73 | 0.43 | 7.29 | -- | ||
NVIDIA Nemotron Nano 9B V2 | 131k | Open | 7* | -- | 87 | 7.77 | 13.54 | -- | ||
NVIDIA Nemotron Nano 9B V2 | 131k | Open | 7* | -- | 167 | 1.18 | 4.16 | -- | ||
Hermes 4 70B (FP8) | 128k | Open | 7* | -- | 94 | 1.34 | 6.64 | -- | ||
Granite 4.1 8B | 131k | Open | 7* | -- | 108 | 0.81 | 5.45 | -- | ||
Sarvam 30B (high) | 64k | Open | 7* | -- | -- | -- | -- | -- | ||
Ministral 3 3B | 256k | Open | 6 | $0.13 | 400 | 1.04 | 2.29 | -- | ||
Ministral 3 3B | 131k | Open | 6 | $0.13 | 255 | 0.61 | 2.57 | -- | ||
Llama 3.2 90B (Vision) | 8.19k | Open | 6* | -- | -- | -- | -- | -- | ||
Phi-4 Mini | 128k | Open | 6 | $0.00 | 44 | 0.83 | 12.20 | -- | ||
Jamba 1.7 Large | 256k | Open | 5* | -- | 58 | 1.39 | 10.00 | -- | ||
Granite 4.0 H Small | 128k | Open | 5* | -- | 431 | 10.21 | 11.37 | -- | ||
Qwen3 Omni 30B A3B | 65.5k | Open | 5* | -- | 94 | 1.86 | 7.16 | -- | ||
Phi-4 | 16.4k | Open | 5* | -- | -- | -- | -- | -- | ||
Phi-4 | 16.4k | Open | 5* | -- | 75 | 0.81 | 7.45 | -- | ||
Nova Micro | 130k | Proprietary | 5* | -- | 283 | 0.93 | 2.69 | -- | ||
NVIDIA Nemotron Nano 12B v2 VL | 128k | Open | 5* | -- | 206 | 1.14 | 3.57 | -- | ||
NVIDIA Nemotron Nano 12B v2 VL (FP8) | 131k | Open | 5* | -- | 68 | 6.34 | 13.65 | -- | ||
Phi-4 Multimodal | 128k | Open | 5* | -- | 18 | 0.85 | 28.48 | -- | ||
Reka Flash 3 | 54k | Open | 4* | -- | -- | -- | -- | -- | ||
Llama 3.2 11B (Vision) | 8.19k | Open | 3* | -- | -- | -- | -- | -- | ||
Llama 3.2 11B (Vision) | 131k | Open | 3* | -- | 13 | 1.38 | 40.75 | -- | ||
Olmo 3 7B | 65.5k | Open | 3* | -- | -- | -- | -- | -- | ||
Apertus 70B Instruct | 64k | Open | 2* | -- | -- | -- | -- | -- | ||
LFM2.5-VL-1.6B | 32.8k | Open | 1* | -- | 372 | 3.05 | 4.39 | -- | ||
Tiny Aya Global | 8.19k | Open | 1* | -- | -- | -- | -- | -- | ||
Apertus 8B Instruct | 64k | Open | 1* | -- | -- | -- | -- | -- | ||
Claude Sonnet 5 (low) | 1M | Proprietary | -- | -- | 63 | 1.69 | 9.63 | -- | ||
Claude Sonnet 5 (xhigh) | 1M | Proprietary | -- | -- | 69 | 46.39 | 53.60 | -- | ||
Claude Sonnet 5 (high) | 1M | Proprietary | -- | -- | 67 | 14.33 | 21.78 | -- | ||
Cogito v2.1 | 164k | Open | -- | -- | -- | -- | -- | -- | ||
Claude Sonnet 5 (medium) | 1M | Proprietary | -- | -- | 62 | 2.12 | 10.15 | -- | ||