Institute of Foundation Models：模型智能、性能与价格

While higher intelligence models are typically more expensive, they do not all follow the same price-quality curve.

Larger context windows are relevant to RAG (Retrieval Augmented Generation) LLM workflows which typically involve reasoning and information retrieval of large amounts of data.

While higher intelligence models are typically more expensive, they do not all follow the same price-quality curve.

Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Time to first answer token received, in seconds, after API request sent. For reasoning models, this includes the 'thinking' time of the model before providing an answer. For models which do not support streaming, this represents time to receive the completion.

Price per token, shown in USD per million tokens. Price is a blend of cache hit, input, and output token prices using the selected ratio (default 7:2:1 cache-input-output).