Text to Image AI Model & Provider Leaderboard
Analysis and comparison of Text to Image generation models & API providers. Artificial Analysis has analyzed text to image models and hosting providers across quality, generation time, and price. For further details, see our methodology page.
Text to image models & providers compared: Playground v2.5, Stable Diffusion 3 Medium, Stable Diffusion XL 1.0, SDXL Lightning, Stable Diffusion 1.5, Stable Diffusion 2.1, Amazon Titan G1 (Standard), DALLE 2, DALLE 3 HD, DALLE 3, Stable Diffusion 1.6, Stable Diffusion 3 Large Turbo, Stable Diffusion 3 Large, Amazon Titan G1 v2 (Standard), Playground v3 (beta), Ideogram v2, FLUX.1 [pro], FLUX.1 [dev], Ideogram v2 Turbo, Ideogram v1, FLUX1.1 [pro], Recraft 20B, FLUX.1 [schnell], Stable Diffusion 3.5 Large, Stable Diffusion 3.5 Large Turbo, and Recraft V3.
Highlights
Quality ELO
Quality ELO: ELO score of model in Image Arena, Higher is better
Generation Time
Generation time: Seconds to generate 1 image, Lower is better
Price
Price: USD per 1000 image generations, Lower is better
Summary Analysis
Quality vs. Price
Quality ELO: ELO score of model in Image Arena, Price: USD per 1000 image generations
Most attractive quadrant
Size represents Generation time: Seconds to generate 1 image
Quality ELO: Relative ELO score of the models as determined by >100,000 responses from users in Artificial Analysis' Image Arena. Some models may not be shown due to not yet having enough votes.
Price: Price per 1k images generated by the model. For detail on how we calculate price per image for providers price based on inference time or steps, see our methodology page.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.
Quality vs. Generation Time
Quality ELO: ELO score of model in Image Arena, Generation time: Seconds to generate 1 image
Most attractive quadrant
Size represents Price: USD per 1000 image generations
Quality ELO: Relative ELO score of the models as determined by >100,000 responses from users in Artificial Analysis' Image Arena. Some models may not be shown due to not yet having enough votes.
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.
Generation Time vs. Price
Generation time: Seconds to generate 1 image, Price: USD per 1000 image generations
Most attractive quadrant
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Price: Price per 1k images generated by the model. For detail on how we calculate price per image for providers price based on inference time or steps, see our methodology page.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.
Quality
Quality ELO (Image Arena)
Quality ELO: ELO score of model in Image Arena, Higher is better
Quality ELO: Relative ELO score of the models as determined by >100,000 responses from users in Artificial Analysis' Image Arena. Some models may not be shown due to not yet having enough votes.
Arena Win Rate
Arena Win Rate: % Win rate in Image Arena, Higher is better
Win Rate: Proportion of time an image generated by the model was selected as preferred compared to the other image present in Artificial Analysis' Image Arena.
Participate in the Image Arena to contribute to the crowdsourced quality evaluations
Generation Time
Generation Time
Generation time: Seconds to generate 1 image, Lower is better
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Note on Midjourney: Midjourney does not have an API. We benchmark Midjourney as an API using ImagineAPI which serves as a tool to access the Midjourney Discord.
Generation Time, Variance
Generation time: Seconds to generate 1 image, Results by percentile, Lower is better
Median, Other points represent 5th, 25th, 75th, 95th Percentiles respectively
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Boxplot: Shows variance of measurements
Generation Time, Over Time
Generation time: Seconds to generate 1 image, Lower is better
Generation Time: Median time the provider takes to generate an image over the past 14 days of measurements. This includes downloading the image from the provider where a URL is provided rather than an image response.
Over time measurement: Median measurement per day, based on 4 measurements each day at different times. Labels represent start of week's measurements.
Price
Price
Price: USD per 1000 image generations, Lower is better
Price: Price per 1k images generated by the model. For detail on how we calculate price per image for providers price based on inference time or steps, see our methodology page.
Summary of key metrics & further information
| Provider | Model | Footnotes | Model Quality ELO | Median Generation Time (s) | Price per 1k Images (USD) | Further Details |
|---|---|---|---|---|---|---|
 Recraft AI | Recraft V3 | 1169 | 8.8 | $ | ||
![FLUX1.1 [pro] logo](/img/logos/blackforestlabs_small.svg) Black Forest Labs | FLUX1.1 [pro] | 1135 | 4.2 | $40.00 | ||
![FLUX1.1 [pro] logo](/img/logos/fal_small.png) fal.ai | FLUX1.1 [pro] | 1135 | 3.0 | $40.00 | ||
![FLUX1.1 [pro] logo](/img/logos/replicate_small.svg) Replicate | FLUX1.1 [pro] | 1135 | 9.4 | $50.00 | ||
![FLUX1.1 [pro] logo](/img/logos/togetherai_small.svg) Together.ai | FLUX1.1 [pro] | 1135 | 3.9 | $40.00 | ||
| Replicate | FLUX.1 [pro] | 1114 | 10.0 | $55.00 | ||
| Black Forest Labs | FLUX.1 [pro] | 1114 | 23.7 | $ | ||
| Together.ai | FLUX.1 [pro] | 1114 | 8.7 | $50.00 | ||
| fal.ai | FLUX.1 [pro] | 1114 | 8.7 | $50.00 | ||
 Ideogram | Ideogram v2 | 1094 | 20.5 | $80.00 | ||
| Replicate | FLUX.1 [dev] | 1091 | 3.5 | $30.00 | ||
| Black Forest Labs | FLUX.1 [dev] | 1091 | 10.3 | $ | ||
| fal.ai | FLUX.1 [dev] | 1091 | 3.0 | $25.00 | ||
| Ideogram | Ideogram v2 Turbo | 1086 | 11.8 | $50.00 | ||
| Replicate | Stable Diffusion 3.5 Large Turbo | 1084 | 7.7 | $40.00 | ||
 Stability.ai | Stable Diffusion 3.5 Large Turbo | 1084 | 7.6 | $40.00 | ||
| Replicate | Stable Diffusion 3.5 Large | 1081 | 10.9 | $65.00 | ||
| Stability.ai | Stable Diffusion 3.5 Large | 1081 | 8.1 | $65.00 | ||
| fal.ai | Stable Diffusion 3.5 Large | 1081 | 4.4 | $65.00 | ||
| Ideogram | Ideogram v1 | 1069 | 16.0 | $60.00 | ||
| Stability.ai | Stable Diffusion 3 Large | 1059 | 7.4 | $65.00 | ||
 Playground AI | Playground v3 (beta) | 1046 | 17.6 | $0.70 | ||
| Together.ai | FLUX.1 [schnell] | 1045 | 1.1 | $3.00 | ||
| Replicate | FLUX.1 [schnell] | 1045 | 1.6 | $3.00 | ||
| fal.ai | FLUX.1 [schnell] | 1045 | 0.6 | $3.00 | ||
| Recraft AI | Recraft 20B | 1017 | 8.7 | $ | ||
| fal.ai | Playground v2.5 | 996 | 4.4 | $5.13 | ||
| Replicate | Playground v2.5 | 996 | 7.7 | $10.67 | ||
 Fireworks | Playground v2.5 | 996 | 1.6 | $6.50 | ||
| Playground AI | Playground v2.5 | 996 | 6.8 | $0.70 | ||
 OpenAI | DALLE 3 HD | 984 | 17.5 | $80.00 | ||
| OpenAI | DALLE 3 | 970 | 14.5 | $40.00 | ||
| fal.ai | Stable Diffusion 3 Medium | 942 | 2.4 | $35.00 | ||
| Replicate | Stable Diffusion 3 Medium | 942 | 4.7 | $35.00 | ||
| Stability.ai | Stable Diffusion 3 Medium | 942 | 7.4 | $35.00 | ||
 Amazon Bedrock | Amazon Titan G1 v2 (Standard) | 940 | 12.2 | $10.00 | ||
| Stability.ai | Stable Diffusion 3 Large Turbo | 935 | 2.1 | $40.00 | ||
| Stability.ai | Stable Diffusion 1.6 | 926 | 5.0 | $10.00 | ||
| Amazon Bedrock | Amazon Titan G1 (Standard) | 919 | 11.2 | $10.00 | ||
| fal.ai | SDXL Lightning | 909 | 1.1 | $1.01 | ||
| Replicate | SDXL Lightning | 909 | 2.1 | $2.65 | ||
| fal.ai | Stable Diffusion XL 1.0 | 885 | 1.5 | $3.50 | ||
| Replicate | Stable Diffusion XL 1.0 | 885 | 9.8 | $9.04 | ||
| Amazon Bedrock | Stable Diffusion XL 1.0 | 885 | 6.1 | $40.00 | ||
| Fireworks | Stable Diffusion XL 1.0 | 885 | 1.1 | $3.90 | ||
| Stability.ai | Stable Diffusion XL 1.0 | 885 | 4.0 | $6.00 | ||
| Together.ai | Stable Diffusion XL 1.0 | 885 | 3.8 | $20.00 | ||
| OpenAI | DALLE 2 | 742 | 12.6 | $20.00 | ||
| Replicate | Stable Diffusion 2.1 | 737 | 6.2 | $6.71 | ||
| Replicate | Stable Diffusion 1.5 | 623 | 71.5 | $8.56 |