This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

Google has launched a newer release, Gemma 4 26B A4B. We suggest considering it instead.

•

Open weights model

•

Released March 2025

Gemma 3 12B Instruct API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Gemma 3 12B Instruct for your use-case.

Lowest Time per Task

Time per Intelligence Index task (minutes)

Total 3 providers

Lowest Cost per Task

Cost per Intelligence Index task

Total 3 providers

Gemma 3 12B is available through 3 API providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

    Inference time (minutes) per Intelligence Index task · Lower is better
    No data available
    Weighted average cost (USD) per Intelligence Index task · Lower is better
    No data available

    Pricing

    Cost per Intelligence Index Task: Gemma 3 12B Instruct

    Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
    No data available

    Pricing: Cache Hit, Input, and Output: Gemma 3 12B Instruct

    Price (USD per M Tokens) · Lower is better

    Output Speed vs. Cost per Task: Gemma 3 12B Instruct

    Output speed: output tokens divided by total request time, including time to first token · Weighted average cost (USD) per Intelligence Index task
    Most attractive quadrant
    No data available

    Speed

    Average of the single-request and multi-turn agentic workloads measured

    Output Speed: Gemma 3 12B Instruct

    Output tokens divided by total request time · Includes time to first token · Average of the single-request and multi-turn agentic workloads measured · Higher is better

    Latency

    Average of the single-request and multi-turn agentic workloads measured

    Time to First Answer Token: Gemma 3 12B Instruct

    Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

    Reliability

    Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

    Endpoint Error Rate: Gemma 3 12B Instruct

    Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

    Key Comparison Metrics & API Features

    Amazon Bedrock logoAmazon Bedrock
    --
    --
    2.64
    0.0%
    128k
    Open
    DeepInfra logoDeepInfra
    --
    --
    1.82
    0.0%
    131k
    Open
    Google logoGoogle
    --
    --
    --
    --
    128k
    Open

    Frequently Asked Questions

    Common questions about Gemma 3 12B Instruct providers