요약 분석

시각적 추론과 이미지 입력 가격

Visual reasoning intelligence: MMMU Pro evaluation · Image input price: USD per 1k images at 1MP (1024x1024)

Most attractive quadrant

Based on the MMMU Pro evaluation of 1.7k questions, this represents the model's ability to interpret and reason over images.

Price for 1,000 images at a resolution of 1 Megapixel (1024 x 1024) processed by the model.

시각적 추론과 지연 시간(이미지 1장 및 언어 토큰 1,000개 입력)

Visual reasoning intelligence: MMMU Pro evaluation · Seconds to first token received

Most attractive quadrant

Based on the MMMU Pro evaluation of 1.7k questions, this represents the model's ability to interpret and reason over images.

Time to first token received, in seconds, after API request sent. For reasoning models which share reasoning tokens, this will be the first reasoning token. For models which do not support streaming, this represents time to receive the completion.

지능

시각적 추론 지능(MMMU Pro 평가)

Visual reasoning intelligence: MMMU Pro evaluation

Multimodal reasoning quality evaluation based on 1.7k questions which require interpreting and reasoning over images.

가격

Pricing: Image Input Pricing

Image input price: USD per 1k images at 1MP (1024x1024)

Price for 1,000 images at a resolution of 1 Megapixel (1024 x 1024) processed by the model.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

가격: 언어 입력, 이미지 입력 및 언어 출력

Price (USD per M Tokens) · Image input price: USD per 1k images at 1MP (1024x1024) · Lower is better

Price per token included in the request/message sent to the API, represented as USD per million Tokens.

지연 시간 및 속도

지연 시간(이미지 1장 및 언어 토큰 1,000개 입력)

Seconds to first token received · Lower is better

Time to first token received, in seconds, after API request sent. For reasoning models which share reasoning tokens, this will be the first reasoning token. For models which do not support streaming, this represents time to receive the completion.

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

지연 시간 편차(이미지 1장 및 언어 토큰 1,000개 입력)

Seconds to first token received · Results by percentile · Lower is better

Time to first token received, in seconds, after API request sent. For reasoning models which share reasoning tokens, this will be the first reasoning token. For models which do not support streaming, this represents time to receive the completion.

출력 속도(이미지 1장 및 언어 토큰 1,000개 입력)

Output tokens per second · Higher is better

Tokens per second received while the model is generating tokens (ie. after first chunk has been received from the API for models which support streaming).

Figures represent performance of the model's first-party API (e.g. OpenAI for o1) or the median across providers where a first-party API is not available (e.g. Meta's Llama models).

비전 모델: 이미지 입력을 지원하는 LLM

지능

속도

가격

요약 분석

시각적 추론과 이미지 입력 가격

Visual Reasoning

Price per 1k 1MP Images

시각적 추론과 지연 시간(이미지 1장 및 언어 토큰 1,000개 입력)

Visual Reasoning

Latency (Time to First Token)

지능

시각적 추론 지능(MMMU Pro 평가)

MMMU Pro

가격

Pricing: Image Input Pricing

Price per 1k 1MP Images

Model Performance Representation

가격: 언어 입력, 이미지 입력 및 언어 출력

Input Price

지연 시간 및 속도

지연 시간(이미지 1장 및 언어 토큰 1,000개 입력)

Latency (Time to First Token)

Model Performance Representation

지연 시간 편차(이미지 1장 및 언어 토큰 1,000개 입력)

Latency (Time to First Token)

Boxplot

출력 속도(이미지 1장 및 언어 토큰 1,000개 입력)

Output Speed

Model Performance Representation