Speech to Text AI Model & Provider Leaderboard
Compare word error rate, speed, and pricing across Speech to Text models and providers. Our comprehensive analysis helps you choose the best Speech to Text model for your specific use case and requirements.
For further details, see our methodology page.
Coming soon
Voice Agents Report
Highlights
Artificial Analysis Word Error Rate (AA-WER) Index by Model
Artificial Analysis Word Error Rate (AA-WER) Index by Model
Measures transcription accuracy across 3 datasets to evaluate models in real-world speech with diverse accents, domain-specific language, and challenging channel & acoustic conditions.
AA-WER is calculated as an audio-duration-weighted average of WER across ~2 hours from three datasets: VoxPopuli, Earnings-22, and AMI-SDM. See methodology for more detail.
Compared to Whisper, GPT-4o Transcribe smooths transcripts, which results in lower word-for-word accuracy, especially on less structured speech (e.g., meetings, earnings calls).
API Benchmarks
Artificial Analysis Word Error Rate Index vs. Price
Measures transcription accuracy across 3 datasets to evaluate models in real-world speech with diverse accents, domain-specific language, and challenging channel & acoustic conditions.
AA-WER is calculated as an audio-duration-weighted average of WER across ~2 hours from three datasets: VoxPopuli, Earnings-22, and AMI-SDM. See methodology for more detail.
Cost in USD per 1000 minutes of audio transcribed. Reflects the pricing model of the transcription service or software.
Speed Factor
Speed Factor
Audio file seconds transcribed per second of processing time. Higher factor indicates faster transcription speed.
Artificial Analysis measurements are based on a audio duration of 10 minutes. Speed Factor may vary for other durations, particularly for very short durations (under 1 minute).
Price
Price of Transcription
Cost in USD per 1000 minutes of audio transcribed. Reflects the pricing model of the transcription service or software.
For providers which do not price based on audio duration and rather on processing time (incl. Replicate, fal), we have calculated an indicative per minute price based on processing time expected per minute of audio.Further detail present on methodology page.
Note: Groq chargers for a minimum of 10s per request.
| Provider | Model | Whisper version | Footnotes | Word Error Rate (%) | Median Speed Factor | Price (USD per 1000 minutes) | Further Details |
|---|---|---|---|---|---|---|---|
 OpenAI | Whisper Large v2 | large-v2 | 15.8% | 26.3 | 6.00 | ||
 Microsoft Azure | Whisper Large v2 | large-v2 | 27.2% | 34.3 | 6.00 | ||
 fal.ai | Wizper Large v3 | large-v3 | 16.8% | 311.9 | 0.50 | ||
 Replicate | Incredibly Fast Whisper | large-v3 | 18.2% | 64.8 | 1.49 | ||
| Replicate | Whisper Large v2 | large-v2 | 15.8% | 2.3 | 3.47 | ||
| Replicate | Whisper Large v3 | large-v3 | 24.6% | 2.9 | 4.23 | ||
| Replicate | WhisperX | large-v3 | 16.3% | 19.0 | 1.09 | ||
 Groq | Whisper Large v3 | large-v3 | 16.8% | 270.0 | 1.85 | ||
 DeepInfra | Whisper Large v3 | large-v3 | 16.8% | 90.7 | 0.45 | ||
| fal.ai | Whisper Large v3 | large-v3 | 16.8% | 137.6 | 1.15 | ||
| Groq | Whisper Large v3 Turbo | v3 Turbo | 369.8 | 0.67 | |||
 Fireworks | Whisper Large v3 | large-v3 | 445.1 | 1.00 | |||
| Fireworks | Whisper Large v3 Turbo | v3 Turbo | 17.8% | 512.0 | 1.00 | ||
 SambaNova | Whisper-Large-v3 | large-v3 | 16.8% | 95.0 | 1.67 | ||
 Together.ai | Whisper Large v3 | large-v3 | 24.6% | 127.3 | 1.50 | ||
 Speechmatics | Speechmatics Standard | 16.0% | 43.8 | 4.00 | |||
| Speechmatics | Speechmatics Enhanced | 14.4% | 24.3 | 6.70 | |||
| Microsoft Azure | Azure Realtime Speech to Text | 17.2% | 2.0 | 16.67 | |||
 Deepgram | Nova-2 | 17.3% | 414.5 | 4.30 | |||
| Deepgram | Base | 21.9% | 402.4 | 12.50 | |||
| Deepgram | Nova-3 | 18.3% | 584.6 | 4.30 | |||
 AssemblyAI | Universal, AssemblyAI | 14.5% | 81.7 | 2.50 | |||
| AssemblyAI | Slam-1 | 15.1% | 57.4 | 4.50 | |||
 Amazon Bedrock | Amazon Transcribe | 14.0% | 18.9 | 24.00 | |||
 Google | Chirp | 14.6 | 16.00 | ||||
| Google | Chirp 2, Google | 11.6% | 18.2 | 16.00 | |||
| Google | Chirp 3, Google | 15.0% | 28.8 | 16.00 | |||
 ElevenLabs | Scribe, ElevenLabs | 41.2 | 6.67 | ||||
| ElevenLabs | Scribe v2 | 14.0% | 35.2 | 6.67 | |||
| Google | Gemini 2.0 Flash | 17.9% | 55.2 | 1.40 | |||
| Google | Gemini 2.0 Flash Lite | 16.6% | 57.0 | 0.19 | |||
| Google | Gemini 2.5 Flash Lite | 16.1% | 82.6 | 0.58 | |||
| Google | Gemini 2.5 Flash | 19.2% | 93.3 | 1.92 | |||
| Google | Gemini 2.5 Pro | 15.0% | 13.5 | 0.00 | |||
| OpenAI | GPT-4o Transcribe | 21.3% | 28.9 | 6.00 | |||
| OpenAI | GPT-4o Mini Transcribe | 20.1% | 43.7 | 3.00 | |||
| Replicate | Parakeet RNNT 1.1B | 6.5 | 1.91 | ||||
 NVIDIA | Parakeet TDT 0.6B V2, NVIDIA | 55.2 | 0.00 | ||||
| Replicate | Canary Qwen 2.5B, NVIDIA | 13.2% | 5.8 | 0.74 | |||
 Hathora | Parakeet TDT 0.6B V3, Hathora | 13.0% | 26.0 | 1.32 | |||
 Mistral | Voxtral Mini | 15.8% | 55.9 | 1.00 | |||
| Mistral | Voxtral Small | 14.7% | 68.0 | 4.00 | |||
| DeepInfra | Voxtral Small | 14.7% | 24.3 | 3.00 | |||
| DeepInfra | Voxtral Mini | 15.8% | 71.8 | 1.00 | |||
 Gladia | Solaria-1, Gladia | 17.4% | 46.8 | 8.33 | |||
| Amazon Bedrock | Nova 2 Omni | 15.9% | 39.1 | 1.85 | |||
| Amazon Bedrock | Nova 2 Pro | 15.8% | 23.3 | 3.10 |
Speech to Text models & providers compared: Whisper Large v2, OpenAI, Standard, Whisper (L, v2), Azure, Azure Realtime Speech to Text, Speechmatics Enhanced, Wizper (L, v3), fal.ai, Incredibly Fast Whisper, Replicate, Nova-2, Whisper (L, v2), Replicate, Base, Whisper (L, v3), Replicate, WhisperX, Replicate, Whisper (L, v3), Groq, Whisper (L, v3), Deepinfra, Whisper (L, v3), fal.ai, Whisper (L, v3, Turbo), Groq, Whisper (L, v3), Fireworks, Whisper (L, v3, Turbo), Fireworks, Universal, AssemblyAI, Amazon Transcribe, Nova-3, Chirp, Chirp 2, Google, Scribe, ElevenLabs, Gemini 2.0 Flash, Gemini 2.0 Flash Lite, GPT-4o Transcribe, GPT-4o Mini Transcribe, Whisper (L, v3), SambaNova, Parakeet RNNT 1.1B, Replicate, Whisper Large v3, together.ai, Voxtral Mini, Voxtral Small, Voxtral Small, Deepinfra, Voxtral Mini, Deepinfra, Parakeet TDT 0.6B V2, NVIDIA, Canary Qwen 2.5B, Replicate, Slam-1, Gemini 2.5 Flash Lite, Gemini 2.5 Flash, Gemini 2.5 Pro, Chirp 3, Google, Solaria-1, Gladia, Scribe v2, Nova 2 Omni, Nova 2 Pro, and Parakeet TDT 0.6B V3, Hathora.