Baseten: Models Intelligence, Performance & Price
Analysis of Baseten's models across key metrics including quality, price, output speed, latency, context window & more. This analysis is intended to support you in choosing the best model provided by Baseten for your use-case.
Most Intelligent
Intelligence index
Total 8 models
Fastest
Output speed
Total 8 models
Lowest Price
Blended price (per 1M tokens)
Total 8 models
Baseten offers 8 models, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across models.
- For intelligence, the top models on Baseten are Kimi K3 (max) (57), GLM-5.2 (max) (51), and DeepSeek V4 Pro (high) (43).
- For output speed, the fastest models are GLM-4.7 (186 t/s), GLM-4.7 (179 t/s), and DeepSeek V3.1 (FP8) (172 t/s).
- For latency, GLM-4.7 (0.70s), DeepSeek V3.1 (FP8) (0.74s), and GLM-4.7 (11.89s) offer the lowest time to first answer token.
- For pricing, gpt-oss-120b (high) ($0.14), gpt-oss-120b (low) ($0.14), and GLM-4.7 ($0.42) offer the lowest blended prices per 1M tokens. Prices vary up to 3.0x across models.
- For context window size, Kimi K3 (max) (262k), GLM-5.2 (max) (261k), and GLM-4.7 (200k) support the largest context windows on Baseten.
Highlights
Intelligence Evaluations
Artificial Analysis Intelligence Index
Intelligence Evaluations
Agentic real-world work tasks, (Elo-500)/2000
Agentic tool use
Agentic coding & terminal use
Coding
Reasoning & knowledge
Scientific reasoning
Physics reasoning
Knowledge
1 - hallucination rate
Long context reasoning
Agentic knowledge work, Elo
Agentic SaaS workflows
Legal agentic work, criterion pass rate
Agentic business operations
Instruction following
Long-horizon agentic tasks
Kubernetes incident root-cause analysis
Visual reasoning
Intelligence Index vs. Price
Context Window
Context Window
Pricing
Intelligence Index vs. Price
Performance Summary
Output Speed vs. Price
Speed
Measured by Output Speed (tokens per second)
Output Speed
Latency
Measured by Time (seconds) to First Token
Latency: Time To First Answer Token
End-to-End Response Time
Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed
End-to-End Response Time vs. Price
Further Analysis | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
Kimi K3 (max) | 262k | Open | 57 | $1.29 | 120 | 1.59 | 22.45 | 16.69 | |||
GLM-5.2 (max) | 261k | Open | 51 | $0.45 | 121 | 2.14 | 22.73 | 16.47 | |||
DeepSeek V4 Pro (high) | 131k | Open | 43 | $0.68 | 143 | 0.57 | 17.99 | 13.93 | |||
GLM-4.7 | 200k | Open | 34 | $0.17 | 179 | 0.71 | 14.68 | 11.18 | |||
GLM-4.7 | 200k | Open | 27* | -- | 186 | 0.70 | 3.38 | -- | |||
gpt-oss-120b (high) | 128k | Open | 24 | $0.05 | 165 | 0.27 | 15.42 | 12.12 | |||
DeepSeek V3.1 (FP8) | 164k | Open | 21* | -- | 172 | 0.74 | 3.66 | -- | |||
gpt-oss-120b (low) | 128k | Open | 15 | $0.01 | 151 | 0.28 | 16.84 | 13.25 | |||
Key definitions
Frequently Asked Questions
Common questions about Baseten
Baseten offers 8 models that we track: Kimi K3 (max), GLM-5.2 (max), DeepSeek V4 Pro (high), GLM-4.7, GLM-4.7, gpt-oss-120b (high), DeepSeek V3.1 (FP8), and gpt-oss-120b (low).
The most intelligent model available on Baseten is Kimi K3 (max) with an Intelligence Index score of 57.
The fastest model on Baseten by output speed is GLM-4.7 at 186.0 tokens per second.
The model with the lowest time to first answer token on Baseten is GLM-4.7 at 0.70s. Lower latency means faster initial response time.
The most affordable model on Baseten by blended price is gpt-oss-120b (high) at $0.14 per 1M tokens (7:2:1 cache hit/input/output ratio).
Prices on Baseten vary up to 17x across models, from $0.14 per 1M tokens for gpt-oss-120b (high) to $2.31 per 1M tokens for Kimi K3 (max).
Yes, Baseten offers an OpenAI-compatible API, making it easy to switch from OpenAI or use existing OpenAI SDK integrations.
Yes, all 8 models on Baseten support JSON mode for structured output.
Yes, all 8 models on Baseten support function calling (tool use).
Yes, Baseten offers 6 reasoning models: Kimi K3 (max), GLM-5.2 (max), DeepSeek V4 Pro (high), GLM-4.7, gpt-oss-120b (high), and gpt-oss-120b (low). Reasoning models use extended thinking to work through complex problems before providing an answer.
Yes, all 8 models on Baseten are open weight models.
Yes, provider performance can vary over time due to infrastructure changes, load balancing, and updates. We continuously benchmark all providers and display historical performance trends in the "Over Time" charts.
When choosing a model on Baseten, consider: intelligence (for quality-sensitive tasks), output speed (for throughput-intensive tasks), latency (for interactive applications requiring quick first responses), pricing (for cost-sensitive workloads), and features like context window size, JSON mode, or function calling support.