Public AI: Models Intelligence, Performance & Price

While higher intelligence models are typically more expensive, they do not all follow the same price-quality curve.

Larger context windows are relevant to RAG (Retrieval Augmented Generation) LLM workflows which typically involve reasoning and information retrieval of large amounts of data.

While higher intelligence models are typically more expensive, they do not all follow the same price-quality curve.

Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Time to first token received, in seconds, after API request sent. For reasoning models which share reasoning tokens, this will be the first reasoning token. For models which do not support streaming, this represents time to receive the completion.

The share of cacheable input tokens served from the provider's prompt cache, measured during multi-turn agentic coding sessions. We regularly measure each endpoint and report a representative rate based on recent measurements. Higher values mean more of the input is billed at the cheaper cache-hit price, where the provider offers one, which lowers the effective cost of agentic workloads. For further details, see our methodology page.

Price per token, shown in USD per million tokens. Price is a blend of cache hit, input, and output token prices using the selected ratio (default 7:2:1 cache-input-output).