Menu

logo
Artificial Analysis
HOME

Text to Image AI Model & Provider Leaderboard

Analysis and comparison of Text to Image generation models & API providers. Artificial Analysis has analyzed text to image models and hosting providers across quality, generation time, and price. For further details, see our methodology page.

Text to image models & providers compared: Phoenix 0.9 Ultra, Playground v2.5, Stable Diffusion 3 Medium, Stable Diffusion XL 1.0, SDXL Lightning, Stable Diffusion 1.5, Stable Diffusion 2.1, Amazon Titan G1 (Standard), DALLE 2, DALLE 3 HD, DALLE 3, Midjourney v6, Stable Diffusion 1.6, Stable Diffusion 3 Large Turbo, Stable Diffusion 3 Large, Midjourney v6.1, Amazon Titan G1 v2 (Standard), Playground v3 (beta), Ideogram v2, FLUX.1 [pro], FLUX.1 [dev], Stable Diffusion 3.5 Medium, Ideogram v2 Turbo, Ideogram v1, FLUX1.1 [pro], Recraft 20B, FLUX.1 [schnell], Stable Diffusion 3.5 Large, Stable Diffusion 3.5 Large Turbo, Recraft V3, Luma Photon Flash, Adobe Firefly 3, GPT-4o, Janus Pro, Luma Photon, Lumina Image v2, Phoenix 1.0 Fast, Phoenix 1.0 Ultra, Image-01, Gemini 2.0 Flash Experimental, Reve Image (Halfmoon), Ideogram v2a, Ideogram v2a Turbo, Imagen 3 (v002), Ideogram 3.0, Midjourney v7 Alpha, Sana Sprint 1.6B, HiDream-I1-Dev, and Grok 2.

Highlights

Quality ELO
ELO score in Artificial Analysis Image Arena (relative metric of image generation quality), Higher is better
Generation Time
Generation time: Seconds to generate 1 image, Lower is better
Price
Price: USD per 1000 image generations, Lower is better

Summary Analysis

Quality vs. Price

ELO score in Artificial Analysis Image Arena (relative metric of image generation quality), Price: USD per 1000 image generations
Most attractive quadrant
Size represents Generation time: Seconds to generate 1 image
DALLE 3 HD, OpenAI
Midjourney v6.1, Midjourney
Playground v3 (beta), Playground
Ideogram v2, Ideogram
FLUX.1 [dev], Replicate
FLUX1.1 [pro], Black Forest Labs
SD 3.5 Large
Recraft V3, Recraft
FLUX.1 [dev], Nebius
FLUX.1 [dev], Leonardo.Ai
FLUX.1 [dev], Prodia
Imagen 3 (v002)
FLUX.1 [schnell], Replicate
FLUX.1 [dev], fal.ai
Intelligence ELO: Relative ELO score of the models as determined by >100,000 responses from users in Artificial Analysis' Image Arena. Some models may not be shown due to not yet having enough votes.
Price: Price per 1k images generated by the model. For detail on how we calculate price per image for providers price based on inference time or steps, see our methodology page.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.

Quality vs. Generation Time

ELO score in Artificial Analysis Image Arena (relative metric of image generation quality), Generation time: Seconds to generate 1 image
Most attractive quadrant
Size represents Price: USD per 1000 image generations
Playground v3 (beta), Playground
Ideogram v2, Ideogram
FLUX.1 [dev], Replicate
FLUX1.1 [pro], Black Forest Labs
Recraft V3, Recraft
FLUX.1 [dev], Nebius
FLUX.1 [dev], Leonardo.Ai
FLUX.1 [dev], Prodia
Imagen 3 (v002)
FLUX.1 [schnell], Replicate
FLUX.1 [dev], fal.ai
Intelligence ELO: Relative ELO score of the models as determined by >100,000 responses from users in Artificial Analysis' Image Arena. Some models may not be shown due to not yet having enough votes.
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.

Generation Time vs. Price

Generation time: Seconds to generate 1 image, Price: USD per 1000 image generations
Most attractive quadrant
Playground v3 (beta), Playground
Ideogram v2, Ideogram
FLUX.1 [dev], Replicate
FLUX1.1 [pro], Black Forest Labs
Recraft V3, Recraft
FLUX.1 [dev], Nebius
FLUX.1 [dev], Leonardo.Ai
FLUX.1 [dev], Prodia
Imagen 3 (v002)
FLUX.1 [schnell], Replicate
FLUX.1 [dev], fal.ai
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Price: Price per 1k images generated by the model. For detail on how we calculate price per image for providers price based on inference time or steps, see our methodology page.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.

Artificial Analysis Image Arena Quality ELO

ELO score in Artificial Analysis Image Arena (relative metric of image generation quality), Higher is better
Intelligence ELO: Relative ELO score of the models as determined by >100,000 responses from users in Artificial Analysis' Image Arena. Some models may not be shown due to not yet having enough votes.

 Participate in the Image Arena to contribute to the crowdsourced quality evaluations

Generation Time

Generation Time

Generation time: Seconds to generate 1 image, Lower is better
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.

Generation Time, Variance

Generation time: Seconds to generate 1 image, Results by percentile, Lower is better
Median, Other points represent 5th, 25th, 75th, 95th Percentiles respectively
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Boxplot: Shows variance of measurements
Picture of the author

Generation Time, Over Time

Generation time: Seconds to generate 1 image, Lower is better
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Over time measurement: Median measurement per day, based on 4 measurements each day at different times. Labels represent start of week's measurements.

Price

Price: USD per 1000 image generations, Lower is better
Price: Price per 1k images generated by the model. For detail on how we calculate price per image for providers price based on inference time or steps, see our methodology page.
Summary of key metrics & further information
ProviderFurther
Details
GPT-4o logoOpenAI
GPT-4o logoOpenAI
Recraft V3 logoReplicate
Recraft V3 logofal.ai
Recraft V3 logoRecraft AI
HiDream-I1-Dev logoVivago AI
Reve
Ideogram 3.0 logoIdeogram
Imagen 3 (v002) logoGoogle
FLUX1.1 [pro] logoBlack Forest Labs
FLUX1.1 [pro] logofal.ai
FLUX1.1 [pro] logoReplicate
FLUX1.1 [pro] logoTogether.ai
FLUX1.1 [pro] logoProdia
FLUX.1 [pro] logoReplicate
FLUX.1 [pro] logoBlack Forest Labs
FLUX.1 [pro] logoTogether.ai
FLUX.1 [pro] logoProdia
FLUX.1 [pro] logofal.ai
Image-01 logoMiniMax
Midjourney v6.1 logoMidjourney
FLUX.1 [dev] logoReplicate
FLUX.1 [dev] logoBlack Forest Labs
FLUX.1 [dev] logoFireworks
FLUX.1 [dev] logoNebius
FLUX.1 [dev] logoLeonardo.Ai
FLUX.1 [dev] logoProdia
FLUX.1 [dev] logofal.ai
FLUX.1 [dev] logoWaveSpeed
FLUX.1 [dev] logoWaveSpeed
Ideogram v2 logoIdeogram
Midjourney v6 logoMidjourney
Midjourney v7 Alpha logoMidjourney
Luma Photon logofal.ai
Ideogram v2 Turbo logoIdeogram
Stable Diffusion 3.5 Large Turbo logoReplicate
Stable Diffusion 3.5 Large Turbo logoStability.ai
Stable Diffusion 3.5 Large logoReplicate
Stable Diffusion 3.5 Large logoStability.ai
Stable Diffusion 3.5 Large logofal.ai
Phoenix 1.0 Ultra logoLeonardo.Ai
Ideogram v1 logoIdeogram
Stable Diffusion 3 Large logoStability.ai
Ideogram v2a logoIdeogram
FLUX.1 [schnell] logoTogether.ai
FLUX.1 [schnell] logoFireworks
FLUX.1 [schnell] logoNebius
FLUX.1 [schnell] logoLeonardo.Ai
FLUX.1 [schnell] logoProdia
FLUX.1 [schnell] logoProdia
FLUX.1 [schnell] logoReplicate
FLUX.1 [schnell] logofal.ai
FLUX.1 [schnell] logoWaveSpeed
Ideogram v2a Turbo logoIdeogram
Playground v3 (beta) logoPlayground AI
Phoenix 0.9 Ultra logoLeonardo.Ai
Phoenix 1.0 Fast logoLeonardo.Ai
Recraft 20B logoRecraft AI
Gemini 2.0 Flash Experimental logoGoogle
Luma Photon Flash logofal.ai
Playground v2.5 logofal.ai
Playground v2.5 logoReplicate
Playground v2.5 logoFireworks
Playground v2.5 logoPlayground AI
Lumina Image v2 logofal.ai
Adobe Firefly 3 logoAdobe
DALLE 3 HD logoOpenAI
Stable Diffusion 3.5 Medium logofal.ai
Stable Diffusion 3.5 Medium logoReplicate
Stable Diffusion 3.5 Medium logoStability.ai
Stable Diffusion 3.5 Medium logoFireworks
Grok 2 logoxAI
DALLE 3 logoOpenAI
Stable Diffusion 3 Medium logofal.ai
Stable Diffusion 3 Medium logoReplicate
Stable Diffusion 3 Medium logoStability.ai
Amazon Titan G1 v2 (Standard) logoAmazon Bedrock
Stable Diffusion 3 Large Turbo logoStability.ai
Sana Sprint 1.6B logoReplicate
Stable Diffusion 1.6 logoStability.ai
Amazon Titan G1 (Standard) logoAmazon Bedrock
SDXL Lightning logofal.ai
SDXL Lightning logoReplicate
Stable Diffusion XL 1.0 logofal.ai
Stable Diffusion XL 1.0 logoReplicate
Stable Diffusion XL 1.0 logoAmazon Bedrock
Stable Diffusion XL 1.0 logoFireworks
Stable Diffusion XL 1.0 logoDeepinfra
Stable Diffusion XL 1.0 logoStability.ai
Stable Diffusion XL 1.0 logoTogether.ai
Stable Diffusion XL 1.0 logoNebius
Stable Diffusion XL 1.0 logoLeonardo.Ai
Stable Diffusion XL 1.0 logoProdia
DALLE 2 logoOpenAI
Stable Diffusion 2.1 logoReplicate
Stable Diffusion 2.1 logoTogether.ai
Janus Pro logofal.ai
Stable Diffusion 1.5 logoReplicate
Stable Diffusion 1.5 logoTogether.ai
Stable Diffusion 1.5 logoProdia