•

Open weights model

•

Released July 2026

Inkling (Xhigh) API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Inkling (Xhigh) for your use-case.

Fastest

#1
DatabricksDatabricks
207.8 t/s
#2
Thinking MachinesThinking Machines
171.5 t/s
#3
Modal (NVFP4)Modal (NVFP4)
170.1 t/s
#4
DeepInfra (FP8)DeepInfra (FP8)
142.9 t/s
#5
Together AITogether AI
131.5 t/s

Output speed

Total 6 providers

Lowest Latency

#1
DatabricksDatabricks
11.01 s
#2
Modal (NVFP4)Modal (NVFP4)
12.70 s
#3
Thinking MachinesThinking Machines
13.54 s
#4
DeepInfra (FP8)DeepInfra (FP8)
14.60 s
#5
Together AITogether AI
15.82 s

Time to first answer token

Total 6 providers

Lowest Price

#1
DeepInfra (FP8)DeepInfra (FP8)
$0.71
#2
BasetenBaseten
$0.72
#3
Together AITogether AI
$0.72
#4
Thinking MachinesThinking Machines
$0.72
#5
DatabricksDatabricks
$0.72

Blended price (per 1M tokens)

Total 6 providers

Inkling (xhigh) is available through 6 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

  • For output speed, the top providers are Databricks (207.8 t/s), Thinking Machines (171.5 t/s), and Modal (NVFP4) (170.1 t/s). Speed varies significantly across providers, with a 58% difference between the fastest and slowest.
  • For latency, Databricks (11.01s), Modal (NVFP4) (12.70s), and Thinking Machines (13.54s) offer the lowest time to first answer token.
  • For pricing, DeepInfra (FP8) (0.71), Baseten (0.72), and Together AI (0.72) offer the lowest blended prices per 1M tokens.
  • Databricks offers the best performance with both the highest speed and lowest latency. For cost optimization, DeepInfra (FP8) provides the most competitive pricing.
Output tokens per second · Higher is better
Seconds to first answer token received · Lower is better
USD per 1M tokens (blended) · Lower is better

Update: Default performance benchmarking workload has updated to 10k input tokens to better reflect production use cases. You can still select different workloads above.

Pricing

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens) · Lower is better · 10,000 input tokens

Pricing: Blended Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended) · Lower is better

Pricing: Cache Discount

1 - (cache hit price / input price) · Higher is better

Output Speed vs. Price

Blended at 7:2:1 (cache-input-output) · Output speed: output tokens per second · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Measured by Output Speed (tokens per second)

Output Speed: Inkling (Xhigh)

Output speed: output tokens per second · 10,000 input tokens

Latency vs. Output Speed

Latency: seconds to first token received · Output speed: output tokens per second · 10,000 input tokens
Most attractive quadrant
Pareto line

Latency

Measured by Time (seconds) to First Token

Time to First Answer Token

Seconds to first token received · Lower is better · 10,000 input tokens

End-to-End Response Time

Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

End-to-End Response Time

Seconds to output 500 tokens, including reasoning model 'thinking' time · Lower is better · 10,000 input tokens

Key Comparison Metrics & API Features

DeepInfra logoDeepInfra
131k
Open
--
143
0.58
18.07
13.99
Baseten logoBaseten
262k
Open
$0.72
--
--
--
--
Together AI logoTogether AI
524k
Open
$0.91
129
0.67
20.02
15.48
Modal logoModal
1.05M
Open
$0.86
174
0.91
15.27
11.49
Thinking Machines logoThinking Machines
262k
Open
--
189
1.89
15.13
10.59
Databricks logoDatabricks
1M
Open
$0.61
209
1.37
13.31
9.56

Frequently Asked Questions

Common questions about Inkling (Xhigh) providers