Reference

Artificial Analysis API

Build on independent model benchmarks, pricing, and live performance data across language, image, video, music, and speech. Download the OpenAPI specification to generate clients or connect agent tools.

Base URL
https://artificialanalysis.ai/api/v2
Download spec
OpenAPI for clients and agents
Welcome

Overview

Use our benchmark and market intelligence dataset inside your own products, research, analysis, and monitoring systems. The API provides structured model metadata, benchmark results, pricing, and performance data across language, image, video, music, and speech.

The reference starts with the essentials: authentication, access tiers, rate limits, and data conventions.

Quick start

Getting started

Make your first request in under a minute.

  1. Create a key. Open API key management to create or copy an API key. If you are signed out, we will send you through login and back to your active organisation's API key page. Keys belong to organisations; choose the one that owns the subscription and quota.
  2. Call the API. Send requests to https://artificialanalysis.ai/api/v2 with your key in the x-api-key header. Keep the key server-side. Do not expose it in browsers or mobile apps.
  3. Verify access. Start with the language models endpoint to confirm your key, tier, rate-limit headers, and response parsing:
curl "https://artificialanalysis.ai/api/v2/language/models" \
  -H "x-api-key: YOUR_API_KEY"

Successful responses use the same envelope across the API: tier shows the subscription that served the request, pagination appears on list endpoints, and data contains the payload. A 401 means the key is missing or invalid. A 403 means the key is valid, but the organisation's tier does not cover that endpoint.

Auth

Authentication

Every endpoint requires an API key in the x-api-key header. Create, copy, delete, or regenerate keys from API key management. There is no OAuth flow, bearer-token exchange, or request signing; one header authenticates the request.

curl "https://artificialanalysis.ai/api/v2/language/models" \
  -H "x-api-key: YOUR_API_KEY"

Keys are scoped to organisations. Regenerating a key revokes the old value immediately, so coordinate rotation with every service that uses it.

Treat keys as production secrets. Do not commit them or expose them to clients. If a key leaks, regenerate it from API key management; the old value stops working on the next request.

Plans

Tiers

Access depends on your API tier. Pro covers most business and research use cases. Commercial adds provider-granted measurement-level data and bespoke access terms.

TierWhat you get
FreeThe public language models endpoint with headline indices, median performance, and input/output pricing, plus the documented free-tier media endpoints. Other language model endpoints return a 403 subscription error.
ProThe full V2 surface documented here: model detail, provider data, full pricing (including blended), performance percentiles, and pro-only media endpoints.
CommercialEverything in Pro, plus expanded data access negotiated on a per-organization basis. Examples include raw provider measurements, hardware data, or other ad-hoc additions. Commercial is provisioned manually. Contact the team to discuss scope.
Limits

Rate limits

Rate limits apply per key and reset each day at 00:00 UTC.

TierRequests per day
Free100
Pro500
CommercialCustom. Contact the team

Every response includes X-RateLimit-Limit, X-RateLimit-Remaining, and X-RateLimit-Reset headers. 429 responses also include Retry-After, which tells you how many seconds to wait before retrying.

Need higher volume? Contact the team.

Headers

Response headers

Every authenticated response carries a few headers that describe the request context and quota state.

HeaderDescription
X-AA-TierSubscription tier that served the request: free, pro, or commercial. Mirrors the tier field in the response body.
X-RateLimit-LimitMaximum requests allowed in the current window.
X-RateLimit-RemainingRequests remaining in the current window.
X-RateLimit-ResetUnix timestamp at which the current window resets.
Retry-AfterIncluded on 429 responses. Seconds until the quota resets.
Conventions

Data conventions

These conventions apply across the API.

  • Dates use ISO 8601: 2025-06-15 for calendar dates and 2025-06-15T14:30:00.000Z for timestamps.
  • Country codes use lowercased ISO 3166-1 alpha-2 values: us, cn, gb.
  • End-to-end response times assume 500 answer tokens unless a field name states otherwise.
  • Field names use snake_case. We keep the wire format stable: fields are deprecated, not renamed.
  • Nulls mean "not measured" or "not applicable". They never mean zero.
Versioning

Intelligence Index versioning

artificial_analysis_intelligence_index is a composite score, and what goes into it evolves. We version the index so you can interpret a score in context.

Current version: v4.0. Full composition and version history on the Intelligence Index methodology page.

How versions change:

  • Major version bumps indicate a substantial change to the index definition or interpretation. Scores are best interpreted within the same major version.
  • Minor version bumps indicate methodology changes within the same major version. These may include changes to contributing evaluations, task subsets, graders, scoring/normalization, weightings, anchors, or evaluation refreshes. Scores may or may not change.

Currently included (v4.0, 10 evaluations): GDPval-AA, 𝜏²-Bench Telecom, Terminal-Bench Hard, SciCode, AA-LCR, AA-Omniscience, IFBench, HLE, GPQA Diamond, CritPt.

artificial_analysis_coding_index and artificial_analysis_agentic_index are derived from subsets of these evaluations and are not separately versioned.

Licence

Attribution and licensing

Use of the API requires attribution across all tiers. When you display or share API data, credit Artificial Analysis as the source. A visible byline or footer link is sufficient.

Use of the API is also subject to our Terms of Use. For redistribution rights or bespoke contract terms, contact the team.

Errors

Errors

Errors return a JSON body with an error string and, when useful, a details object. The HTTP status identifies the failure category.

StatusMeaning
400Invalid query parameters. The message names the offending field.
401Missing or invalid API key.
403Your subscription does not cover this endpoint or provider.
404Resource not found, usually because of an invalid slug.
429Daily rate limit exhausted. Check Retry-After before retrying.
500Server error. Retry with exponential backoff. If it persists, contact us.
Endpoint reference

Language Models

Evaluations, pricing, performance, and metadata for language models

Get language models (Free tier)

get/api/v2/language/models/free

Free-tier sibling of /api/v2/language/models. Returns the Free-shape language model response: the public subset of fields. Includes headline indices, median performance, and input/output pricing. Excludes Pro-only fields such as the full evaluation set, token counts, blended pricing, performance percentiles, context window, parameters, modalities, licensing, and provider detail.

Accepts any valid API key (Free, Pro, or Commercial). Pro and Commercial keys also receive the Free-shape body when calling this URL; the tier field reflects the caller's actual tier.

Parameters
Query parameters
  • pageintegerdefault: 1

    Page number for paginated results (1-indexed). Defaults to 1.

Responses
200
  • tierstringrequired
    freeprocommercial
  • intelligence_index_versionnumberrequired

    Version of the Artificial Analysis Intelligence Index the artificial_analysis_intelligence_index scores in this response belong to, as a number with the v dropped (e.g. 4 for v4.0). See the Intelligence Index versioning section for what major vs. minor changes mean.

  • paginationobjectrequired
    • pageintegerrequired

      Current page number (1-indexed).

    • page_sizeintegerrequired

      Number of items per page.

    • total_pagesintegerrequired

      Total number of pages.

    • has_morebooleanrequired

      Whether there are more pages after the current one.

  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • release_datestring?required

      ISO date string (e.g. "2024-05-13").

    • model_creatorobjectrequired
    • evaluationsobjectrequired

      Composite Artificial Analysis indices. Pro tier adds per-benchmark scores.

    • artificial_analysis_intelligence_index_costobjectrequired

      Pre-calculated cost to run the Intelligence Index evaluation. Free tier exposes total_cost only.

    • pricingobjectrequired

      Input and output token pricing. Pro tier adds blended pricing fields.

    • performanceobjectrequired

      Median performance metrics across all providers serving this model. Pro tier adds percentiles and quartiles.

Get all language models

get/api/v2/language/models

Returns language model data including evaluations, pricing, and performance metrics. Detail-only fields (evaluation token counts, omniscience/openness breakdowns, providers) are available on /api/v2/language/models/{slug}.

Pro+ only. Free integrations should use /api/v2/language/models/free instead.

Parameters
Query parameters
  • prompt_typestringdefault: "long"

    The prompt type preset used for performance benchmarking. Controls how many input tokens and parallel queries are used in latency/throughput measurements.

    prompt_typeinput_tokensparallel_queries
    medium1,0001
    long (default)10,0001
    100k100,0001
    vision_single_image1,0001
    medium_coding1,0001
    medium_parallel1,00010
    mediumlong100kvision_single_imagemedium_codingmedium_parallel
  • pageintegerdefault: 1

    Page number for paginated results (1-indexed). Defaults to 1.

Responses
200
  • tierstringrequired
    procommercial
  • intelligence_index_versionnumberrequired

    Version of the Artificial Analysis Intelligence Index the artificial_analysis_intelligence_index scores in this response belong to, as a number with the v dropped (e.g. 4 for v4.0). See the Intelligence Index versioning section for what major vs. minor changes mean.

  • paginationobjectrequired
    • pageintegerrequired

      Current page number (1-indexed).

    • page_sizeintegerrequired

      Number of items per page.

    • total_pagesintegerrequired

      Total number of pages.

    • has_morebooleanrequired

      Whether there are more pages after the current one.

  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • release_datestring?required

      ISO date string (e.g. "2024-05-13").

    • model_creatorobjectrequired
    • reasoning_modelboolean

      Pro tier only. Omitted on Free tier.

    • evaluationsobjectrequired
    • artificial_analysis_intelligence_index_costobjectrequired

      Pre-calculated cost to run the Intelligence Index evaluation. Free tier includes total_cost only; Pro tier adds input_cost, reasoning_cost, answer_cost.

    • artificial_analysis_intelligence_index_token_countsobject

      Pro tier only. Omitted on Free tier.

    • pricingobject

      Full pricing object including blended fields. Free tier returns input and output token prices only. See FreePricing.

    • performanceobject

      Full performance object including quartiles and percentiles. Free tier returns medians only. See FreeModelPerformance.

    • context_window_tokensinteger?

      Pro tier only. Omitted on Free tier. Null when not set for the model.

    • parametersobject

      Pro tier only. Omitted on Free tier.

    • modalitiesobject

      Pro tier only. Omitted on Free tier.

    • licensingobject

      Pro tier only. Omitted on Free tier.

    • huggingface_urlstring?

      Pro tier only. Omitted on Free tier. Canonical Hugging Face or model weights URL when available.

    • openrouter_api_idstring?

      Pro tier only. Omitted on Free tier. OpenRouter API model identifier when available.

    • evaluation_token_countsobject

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

    • aa_omniscience_breakdownobject

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

    • artificial_analysis_openness_index_breakdownobject

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

    • providersarray<object>

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

Get a single language model by slug

get/api/v2/language/models/{slug}

Returns data for a single language model identified by its slug. Includes all pro tier list fields plus detail-only fields: evaluation token counts, omniscience/openness breakdowns, and per-provider data.

Pro and Commercial only. Free tier requests return a 403 subscription error.

Parameters
Path parameters1 required
  • slugstringrequired

    The model slug (e.g. "gemini-3-pro", "claude-opus-4-6", "deepseek-v3").

Query parameters
  • prompt_typestringdefault: "long"

    The prompt type preset used for performance benchmarking. Controls how many input tokens and parallel queries are used in latency/throughput measurements.

    prompt_typeinput_tokensparallel_queries
    medium1,0001
    long (default)10,0001
    100k100,0001
    vision_single_image1,0001
    medium_coding1,0001
    medium_parallel1,00010
    mediumlong100kvision_single_imagemedium_codingmedium_parallel
Responses
200
  • tierstringrequired
    procommercial
  • intelligence_index_versionnumberrequired

    Version of the Artificial Analysis Intelligence Index the artificial_analysis_intelligence_index scores in this response belong to, as a number with the v dropped (e.g. 4 for v4.0). See the Intelligence Index versioning section for what major vs. minor changes mean.

  • dataobjectrequired
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • release_datestring?required

      ISO date string (e.g. "2024-05-13").

    • model_creatorobjectrequired
    • reasoning_modelboolean

      Pro tier only. Omitted on Free tier.

    • evaluationsobjectrequired
    • artificial_analysis_intelligence_index_costobjectrequired

      Pre-calculated cost to run the Intelligence Index evaluation. Free tier includes total_cost only; Pro tier adds input_cost, reasoning_cost, answer_cost.

    • artificial_analysis_intelligence_index_token_countsobject

      Pro tier only. Omitted on Free tier.

    • pricingobject

      Full pricing object including blended fields. Free tier returns input and output token prices only. See FreePricing.

    • performanceobject

      Full performance object including quartiles and percentiles. Free tier returns medians only. See FreeModelPerformance.

    • context_window_tokensinteger?

      Pro tier only. Omitted on Free tier. Null when not set for the model.

    • parametersobject

      Pro tier only. Omitted on Free tier.

    • modalitiesobject

      Pro tier only. Omitted on Free tier.

    • licensingobject

      Pro tier only. Omitted on Free tier.

    • huggingface_urlstring?

      Pro tier only. Omitted on Free tier. Canonical Hugging Face or model weights URL when available.

    • openrouter_api_idstring?

      Pro tier only. Omitted on Free tier. OpenRouter API model identifier when available.

    • evaluation_token_countsobject

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

    • aa_omniscience_breakdownobject

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

    • artificial_analysis_openness_index_breakdownobject

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

    • providersarray<object>

      Pro tier only. Detail endpoint only (/api/v2/language/models/{slug}). Omitted on Free tier and list endpoint.

Get performance over time for a single model

get/api/v2/language/models/{slug}/performance

Returns a time series of performance metrics for the specified model, broken down by API provider. Each provider that offers this model will have its own series of data points within the requested window.

The four metrics tracked per data point are:

  • Output speed — median tokens generated per second (median_output_tokens_per_second)
  • Time to first token — median latency before the first token is returned (median_time_to_first_token_seconds)
  • Time to first answer token — median time until the first answer token is available (median_time_to_first_answer_token_seconds)
  • End-to-end response time — median end-to-end response time in seconds (median_end_to_end_response_time_seconds)

Use window to control how far back the data goes and interval to control the granularity (e.g. window=90d&interval=weekly returns ~13 weekly data points per provider).

Pro and Commercial only. Free tier requests return a 403 subscription error.

Parameters
Path parameters1 required
  • slugstringrequired

    The unique identifier for the model (e.g. claude-sonnet-4). Use the /models endpoint to discover available slugs.

Query parameters
  • windowstringdefault: "90d"

    Lookback period from today. Maximum 90 days for single-model endpoint.

    7d30d90d
  • intervalstring

    Aggregation granularity. Auto-derived from window if omitted (7d/30d → daily, 90d → weekly).

    dailyweeklymonthly
  • prompt_typestringdefault: "long"

    The prompt type preset used for performance benchmarking. Controls how many input tokens and parallel queries are used in latency/throughput measurements.

    prompt_typeinput_tokensparallel_queries
    medium1,0001
    long (default)10,0001
    100k100,0001
    vision_single_image1,0001
    medium_coding1,0001
    medium_parallel1,00010
    mediumlong100kvision_single_imagemedium_codingmedium_parallel
Responses
200
  • tierstringrequired
    procommercial
  • dataobjectrequired
    • idstringrequired
    • slugstringrequired
    • namestringrequired
    • providersarray<object>required

Language Model Providers

Capabilities, pricing, and performance for language model API providers

Get all language model API providers

get/api/v2/language/providers

Returns data for all API providers including the models they offer, pricing, and median performance metrics.

Pro and Commercial only. Free tier requests return a 403 subscription error.

Parameters
Query parameters
  • pageintegerdefault: 1

    Page number for paginated results (1-indexed). Defaults to 1.

Responses
200
  • tierstringrequired
    procommercial
  • paginationobjectrequired
    • pageintegerrequired

      Current page number (1-indexed).

    • page_sizeintegerrequired

      Number of items per page.

    • total_pagesintegerrequired

      Total number of pages.

    • has_morebooleanrequired

      Whether there are more pages after the current one.

  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • countrystring?

      ISO 3166-1 alpha-2 country code of the provider. Null when unknown.

    • modelsarray<object>required

Get a single language model provider by slug

get/api/v2/language/providers/{slug}

Returns data for a single API provider identified by its slug. Includes all fields from the providers list plus full performance percentile and quartile data for each model. Supports custom prompt_type, window, and interval parameters.

Pro and Commercial only. Free tier requests return a 403 subscription error.

Parameters
Path parameters1 required
  • slugstringrequired

    The provider slug (e.g. "openai", "fireworks").

Query parameters
  • prompt_typestringdefault: "long"

    The prompt type preset used for performance benchmarking. Controls how many input tokens and parallel queries are used in latency/throughput measurements.

    prompt_typeinput_tokensparallel_queries
    medium1,0001
    long (default)10,0001
    100k100,0001
    vision_single_image1,0001
    medium_coding1,0001
    medium_parallel1,00010
    mediumlong100kvision_single_imagemedium_codingmedium_parallel
  • windowstringdefault: "90d"

    Lookback period from today.

    7d30d90d
  • intervalstring

    Aggregation granularity. Auto-derived from window if omitted (7d/30d → daily, 90d → weekly).

    dailyweeklymonthly
Responses
200
  • tierstringrequired
    procommercial
  • dataobjectrequired
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • countrystring?

      ISO 3166-1 alpha-2 country code of the provider. Null when unknown.

    • modelsarray<object>required

Get performance over time for a single provider

get/api/v2/language/providers/{slug}/performance

Returns performance time series for each model offered by the specified provider, looking back from today by the specified window.

This is the inverse of the model performance endpoint — here you pick a provider and see how each of their models has performed over time.

Pro and Commercial only. Free tier requests return a 403 subscription error.

Parameters
Path parameters1 required
  • slugstringrequired

    The unique identifier for the provider (e.g. anthropic). Use the /providers endpoint to discover available slugs.

Query parameters
  • windowstringdefault: "90d"

    Lookback period from today.

    7d30d90d
  • intervalstring

    Aggregation granularity. Auto-derived from window if omitted (7d/30d → daily, 90d → weekly).

    dailyweeklymonthly
  • prompt_typestringdefault: "long"

    The prompt type preset used for performance benchmarking. Controls how many input tokens and parallel queries are used in latency/throughput measurements.

    prompt_typeinput_tokensparallel_queries
    medium1,0001
    long (default)10,0001
    100k100,0001
    vision_single_image1,0001
    medium_coding1,0001
    medium_parallel1,00010
    mediumlong100kvision_single_imagemedium_codingmedium_parallel
Responses
200
  • tierstringrequired
    procommercial
  • dataobjectrequired
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • modelsarray<object>required

Media - Image Arena

Image generation arena rankings for text-to-image and image-editing models

Get text-to-image arena rankings (Free tier)

get/api/v2/media/text-to-image/models/free

Free-tier sibling of /api/v2/media/text-to-image/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • rankinteger?

      Pro tier only. Rank among current models by Elo.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • release_datestring?

      Pro tier only. Release date.

    • price_per_1k_imagesnumber?

      Pro tier only. Price per 1,000 images.

    • open_weights_urlstring?

      Pro tier only. URL to open weights; can be used to infer if open weights.

    • categoriesarray<object>

      Pro tier only. Per-category Elo breakdowns. Only present when include_categories=true.

Get text-to-image arena rankings

get/api/v2/media/text-to-image/models

Returns arena Elo rankings for text-to-image models. Free tier returns model identity plus Elo and CI only; Pro adds rank, samples, pricing, release date, open_weights_url, and optional category breakdowns.

Pro+ only. Free integrations should use /api/v2/media/text-to-image/models/free instead.

Parameters
Query parameters
  • include_categoriesbooleandefault: false

    Include per-category Elo breakdowns (Pro tier only).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • rankinteger?

      Pro tier only. Rank among current models by Elo.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • release_datestring?

      Pro tier only. Release date.

    • price_per_1k_imagesnumber?

      Pro tier only. Price per 1,000 images.

    • open_weights_urlstring?

      Pro tier only. URL to open weights; can be used to infer if open weights.

    • categoriesarray<object>

      Pro tier only. Per-category Elo breakdowns. Only present when include_categories=true.

Get image-editing arena rankings (Free tier)

get/api/v2/media/image-editing/models/free

Free-tier sibling of /api/v2/media/image-editing/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • rankinteger?

      Pro tier only. Rank among current models by Elo.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • release_datestring?

      Pro tier only. Release date.

    • price_per_1k_imagesnumber?

      Pro tier only. Price per 1,000 images.

    • open_weights_urlstring?

      Pro tier only. URL to open weights; can be used to infer if open weights.

    • categoriesarray<object>

      Pro tier only. Per-category Elo breakdowns. Only present when include_categories=true.

Get image-editing arena rankings

get/api/v2/media/image-editing/models

Returns arena Elo rankings for image-editing models. Free tier returns model identity plus Elo and CI only; Pro adds rank, samples, pricing, release date, open_weights_url, and optional category breakdowns.

Pro+ only. Free integrations should use /api/v2/media/image-editing/models/free instead.

Parameters
Query parameters
  • include_categoriesbooleandefault: false

    Include per-category Elo breakdowns (Pro tier only).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • rankinteger?

      Pro tier only. Rank among current models by Elo.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • release_datestring?

      Pro tier only. Release date.

    • price_per_1k_imagesnumber?

      Pro tier only. Price per 1,000 images.

    • open_weights_urlstring?

      Pro tier only. URL to open weights; can be used to infer if open weights.

    • categoriesarray<object>

      Pro tier only. Per-category Elo breakdowns. Only present when include_categories=true.

Get text-to-video arena rankings (Free tier)

get/api/v2/media/text-to-video/models/free

Free-tier sibling of /api/v2/media/text-to-video/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

Get text-to-video arena rankings

get/api/v2/media/text-to-video/models

Returns arena Elo rankings for text-to-video models. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns.

Pro+ only. Free integrations should use /api/v2/media/text-to-video/models/free instead.

Parameters
Query parameters
  • include_categoriesbooleandefault: false

    Include per-category Elo breakdowns (Pro and Commercial only; ignored on Free tier).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required

Get image-to-video arena rankings (Free tier)

get/api/v2/media/image-to-video/models/free

Free-tier sibling of /api/v2/media/image-to-video/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

Get image-to-video arena rankings

get/api/v2/media/image-to-video/models

Returns arena Elo rankings for image-to-video models. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns.

Pro+ only. Free integrations should use /api/v2/media/image-to-video/models/free instead.

Parameters
Query parameters
  • include_categoriesbooleandefault: false

    Include per-category Elo breakdowns (Pro and Commercial only; ignored on Free tier).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required

Get text-to-video with audio arena rankings (Free tier)

get/api/v2/media/text-to-video-audio/models/free

Free-tier sibling of /api/v2/media/text-to-video-audio/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

Get text-to-video with audio arena rankings

get/api/v2/media/text-to-video-audio/models

Returns arena Elo rankings for text-to-video models that generate video with audio output. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns.

Pro+ only. Free integrations should use /api/v2/media/text-to-video-audio/models/free instead.

Parameters
Query parameters
  • include_categoriesbooleandefault: false

    Include per-category Elo breakdowns (Pro and Commercial only; ignored on Free tier).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required

Get image-to-video with audio arena rankings (Free tier)

get/api/v2/media/image-to-video-audio/models/free

Free-tier sibling of /api/v2/media/image-to-video-audio/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

Get image-to-video with audio arena rankings

get/api/v2/media/image-to-video-audio/models

Returns arena Elo rankings for image-to-video models that generate video with audio output. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns.

Pro+ only. Free integrations should use /api/v2/media/image-to-video-audio/models/free instead.

Parameters
Query parameters
  • include_categoriesbooleandefault: false

    Include per-category Elo breakdowns (Pro and Commercial only; ignored on Free tier).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required

Get text-to-speech arena rankings (Free tier)

get/api/v2/media/text-to-speech/models/free

Free-tier sibling of /api/v2/media/text-to-speech/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • release_datestring?

      Pro tier only. Release date.

    • price_per_1m_charactersnumber?

      Pro tier only. Price per 1 million characters.

Get text-to-speech arena rankings

get/api/v2/media/text-to-speech/models

Returns arena Elo rankings for text-to-speech models. Free tier returns model identity plus Elo and CI only; Pro adds samples, release date, and pricing.

Pro+ only. Free integrations should use /api/v2/media/text-to-speech/models/free instead.

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • release_datestring?

      Pro tier only. Release date.

    • price_per_1m_charactersnumber?

      Pro tier only. Price per 1 million characters.

Get speech-to-speech model data (Free tier)

get/api/v2/media/speech-to-speech/models/free

Free-tier sibling of /api/v2/media/speech-to-speech/models. Returns the Free-shape response — model identity plus BBA and FDB scores, with Pro-only per-provider pricing and performance data omitted. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (no tier field, no Pro-only fields) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • bba_scorenumber?required

      Big Bench Audio score.

    • fdb_scorenumber?required

      Full Duplex Bench score.

    • tau_voice_scorenumber?required

      𝜏-Voice score (the model's best result across providers). Null when the model has no 𝜏-Voice measurements.

    • providersarray<object>

      Pro tier only. Omitted on Free tier.

Get speech-to-speech model data

get/api/v2/media/speech-to-speech/models

Returns data for speech-to-speech models including quality metrics (BBA and FDB scores). Pro tier also includes per-provider pricing and performance data.

Pro+ only. Free integrations should use /api/v2/media/speech-to-speech/models/free instead.

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • model_creatorobjectrequired
    • bba_scorenumber?required

      Big Bench Audio score.

    • fdb_scorenumber?required

      Full Duplex Bench score.

    • tau_voice_scorenumber?required

      𝜏-Voice score (the model's best result across providers). Null when the model has no 𝜏-Voice measurements.

    • providersarray<object>

      Pro tier only. Omitted on Free tier.

Get speech-to-text models (Free tier)

get/api/v2/media/speech-to-text/models/free

Free-tier sibling of /api/v2/media/speech-to-text/models. Returns the Free-shape response — model identity plus the overall WER index, with Pro-only benchmark breakdowns, open-weights status, and per-provider data omitted. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • model_creatorobjectrequired
    • aa_wer_indexnumber?required

      AA Word Error Rate index.

    • aa_agenttalknumber?

      Pro tier only. AA AgentTalk WER.

    • voxpopuli_cleaned_aanumber?

      Pro tier only. VoxPopuli cleaned WER.

    • earnings_22_cleaned_aanumber?

      Pro tier only. Earnings22 cleaned WER.

    • open_weightsboolean

      Pro tier only. Whether the model has open weights.

    • providersarray<object>

      Pro tier only. Per-provider data.

Get speech-to-text models

get/api/v2/media/speech-to-text/models

Returns speech-to-text model data including quality metrics (word error rates). Free tier returns model identity and overall WER index only. Pro tier adds benchmark-specific WER breakdowns, open weights status, and per-provider data.

Pro+ only. Free integrations should use /api/v2/media/speech-to-text/models/free instead.

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • model_creatorobjectrequired
    • aa_wer_indexnumber?required

      AA Word Error Rate index.

    • aa_agenttalknumber?

      Pro tier only. AA AgentTalk WER.

    • voxpopuli_cleaned_aanumber?

      Pro tier only. VoxPopuli cleaned WER.

    • earnings_22_cleaned_aanumber?

      Pro tier only. Earnings22 cleaned WER.

    • open_weightsboolean

      Pro tier only. Whether the model has open weights.

    • providersarray<object>

      Pro tier only. Per-provider data.

Get instrumental music arena rankings (Free tier)

get/api/v2/media/music/instrumental/models/free

Free-tier sibling of /api/v2/media/music/instrumental/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • genresarray<object>

      Pro tier only. Per-genre Elo breakdowns. Only present when include_genres=true.

Get instrumental music arena rankings

get/api/v2/media/music/instrumental/models

Returns arena Elo rankings for instrumental music generation models. Free tier returns model identity plus Elo and CI only; Pro adds samples and optional genre breakdowns.

Pro+ only. Free integrations should use /api/v2/media/music/instrumental/models/free instead.

Parameters
Query parameters
  • include_genresbooleandefault: false

    Include per-genre Elo breakdowns (Pro tier only).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • genresarray<object>

      Pro tier only. Per-genre Elo breakdowns. Only present when include_genres=true.

Get with-vocals music arena rankings (Free tier)

get/api/v2/media/music/with-vocals/models/free

Free-tier sibling of /api/v2/media/music/with-vocals/models. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the tier field reflects the caller's actual tier) when calling this URL.

Responses
200
  • tierstringrequired
    freeprocommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • genresarray<object>

      Pro tier only. Per-genre Elo breakdowns. Only present when include_genres=true.

Get with-vocals music arena rankings

get/api/v2/media/music/with-vocals/models

Returns arena Elo rankings for music generation models with vocals. Free tier returns model identity plus Elo and CI only; Pro adds samples and optional genre breakdowns.

Pro+ only. Free integrations should use /api/v2/media/music/with-vocals/models/free instead.

Parameters
Query parameters
  • include_genresbooleandefault: false

    Include per-genre Elo breakdowns (Pro tier only).

Responses
200
  • tierstringrequired
    procommercial
  • dataarray<object>required
    • idstringrequired
    • namestringrequired
    • model_creatorobjectrequired
    • elonumberrequired

      Arena Elo rating.

    • ci_95number?required

      95% confidence interval. Null if unavailable.

    • samplesinteger

      Pro tier only. Total number of arena samples.

    • genresarray<object>

      Pro tier only. Per-genre Elo breakdowns. Only present when include_genres=true.

Language Model Measurements

Raw measurement-level data for LLM performance benchmarking.

Commercial only — this endpoint requires a Commercial API key with explicit provider-level grants. Contact us to discuss Commercial access.

Get raw measurements for a provider

get/api/v2/language/providers/{slug}/measurements

Returns individual measurement records for the specified provider, including per-request output speed, time to first token, time to first answer token, estimated end-to-end response time, and success status. Results are grouped by model within the provider.

Commercial tier only. Your API key must have explicit grants for the requested provider. If you are interested in accessing this endpoint, please contact us to discuss Commercial access.

Parameters
Path parameters1 required
  • slugstringrequired

    The unique identifier for the provider (e.g. anthropic). Your Commercial API key must have grants for this provider.

Query parameters
  • prompt_typestringdefault: "long"

    The prompt type preset used for performance benchmarking. Controls how many input tokens and parallel queries are used in latency/throughput measurements.

    prompt_typeinput_tokensparallel_queries
    medium1,0001
    long (default)10,0001
    100k100,0001
    vision_single_image1,0001
    medium_coding1,0001
    medium_parallel1,00010
    mediumlong100kvision_single_imagemedium_codingmedium_parallel
  • start_datestring

    Only return measurements recorded on or after this date (YYYY-MM-DD). Defaults to 90 days ago if omitted.

Responses
200
  • dataobjectrequired
    • idstringrequired
    • namestringrequired
    • slugstringrequired
    • modelsarray<object>required

CritPt Evaluation

Submit code solutions for grading against the CritPt benchmark.

Unlike the other endpoints in this API, this is not a data retrieval endpoint. It is a code evaluation service. You submit generated code for specific CritPt problems and receive grading results from the CritPt evaluation server.

Rate limited to 10 requests per day per user. Rate limit headers (X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Reset, Retry-After) are included in every response.

Submit code for CritPt evaluation

post/api/v2/critpt/evaluate

Submit generated code solutions for grading against CritPt benchmark problems.

This endpoint differs from the rest of the API. It is a code evaluation service, not a data retrieval endpoint. It accepts one or more code submissions and returns grading results from the CritPt evaluation server.

Rate limited to 10 requests per day per user. Rate limit information is returned via X-RateLimit-* response headers.

Request body
Schema
  • submissionsarray<object>required

    One or more code submissions to evaluate.

    • problem_idstringrequired

      The CritPt problem identifier.

    • generated_codestringrequired

      The generated code solution to evaluate.

    • modelstringrequired

      The model that generated the code.

    • generation_configobjectrequired

      Configuration used for code generation (passed through to the grader).

    • messagesarray<object>

      Optional conversation messages that produced the code.

  • batch_metadataobjectrequired

    Metadata about the submission batch (passed through to the grader).

Responses
200Evaluation results from the CritPt grading server.