Meta: API Provider Benchmarking & Analysis
Analysis of Meta API providers across performance metrics including Artificial Analysis Word Error Rate Index, speed, and price.
Artificial Analysis Word Error Rate Index (AA-WER Index) by API
Artificial Analysis Word Error Rate Index (AA-WER Index) by API
% of words transcribed incorrectly · Lower is better · AA-WER v2.2 incorporates 3 datasets: AA-AgentTalk (50%), VoxPopuli-Cleaned-AA (25%), Earnings22-Cleaned-AA (25%)
Note: For Earnings22, if a model cannot reliably handle full-length audio due to time limits, we chunk to ~9 minutes (relevant to: Nova 2 Pro, Amazon, GPT-4o Transcribe, OpenAI, GPT-4o Mini Transcribe, OpenAI). For models with even shorter time limits, we chunk to ~30 seconds (relevant to: Canary Qwen 2.5B, NVIDIA, Inworld STT 1).
API Benchmarks
Artificial Analysis Word Error Rate Index vs. Price
% of words transcribed incorrectly · Lower is better · AA-WER v2.2 incorporates 3 datasets: AA-AgentTalk (50%), VoxPopuli-Cleaned-AA (25%), Earnings22-Cleaned-AA (25%) · USD per 1000 minutes of audio
Most attractive quadrant
Speed Factor
Speed Factor
Input audio seconds transcribed per second · Higher is better
Price
Price of Transcription
USD per 1000 minutes of audio
Summary of Key Metrics & Further Information
Provider | Further Details | ||||
|---|---|---|---|---|---|
Qwen3.5 Omni Flash | 13.5% | 80.2 | $1.51 | ||
Fun-Realtime-ASR-preview | 1.7% | 20.2 | $2.82 | ||
Nova 2 Pro | 4.9% | 23.4 | $3.10 | ||
Amazon Transcribe | 4.1% | 36.7 | $6.00 | ||
AssemblyAI-STT-3.7 | 2.5% | 108.6 | $3.50 | ||
Universal-3.5 Pro | 3.0% | 107.9 | $3.50 | ||
Universal-3 Pro | 3.1% | 101.0 | $3.50 | ||
Universal, AssemblyAI | 3.8% | 101.6 | $2.50 | ||
MAI-Transcribe-2 | 2.0% | 340.4 | $1.67 | ||
MAI-Transcribe-1.5 | 2.4% | 80.5 | $6.00 | ||
Azure Speech 09-2026 | 2.8% | 148.8 | $6.00 | ||
Xing-Audio4.0-ASR-Preview | 2.0% | 19.6 | $1.51 | ||
transcribe-03-2026 | 4.6% | 195.0 | $0.00 | ||
Nova-3 | 5.2% | 408.6 | $4.30 | ||
Nova-3, Telnyx | 4.8% | 341.5 | $5.00 | ||
Nova-2, Telnyx | 5.1% | 321.2 | $5.00 | ||
Scribe v3, ElevenLabs | 1.9% | 59.5 | $3.33 | ||
Scribe v2 | 2.2% | 85.5 | $3.67 | ||
Solaria-1, Gladia | 4.1% | 90.9 | $5.02 | ||
Solaria-3, Gladia | 3.2% | 88.5 | $2.98 | ||
Chirp 3, Google | 4.3% | 30.8 | $16.00 | ||
Chirp | 31.2% | 14.4 | $16.00 | ||
Gemini 3.5 Transcribe | 2.6% | 96.4 | $5.00 | ||
Gemini 3.1 Pro Preview (High) | 2.8% | 9.1 | $18.15 | ||
Gemini 3.1 Pro Preview (Low) | 3.6% | 12.6 | $7.72 | ||
Gemini 3 Flash (High) | 2.9% | 21.5 | $4.17 | ||
Gemini 2.5 Flash Lite | 5.2% | 83.6 | $0.67 | ||
Gemini 2.5 Flash | 5.1% | 70.4 | $2.51 | ||
Gemini 2.5 Pro | 2.9% | 12.8 | $8.69 | ||
Gemini 3.1 Flash-Lite Preview (Minimal) | 3.4% | 75.8 | $1.10 | ||
Gradium Speech-to-Text | 6.8% | 2.8 | $13.00 | ||
Grok Voice Transcribe 2.0 | 2.3% | 162.0 | $1.67 | ||
Inworld STT 1 | 3.9% | 121.3 | $2.50 | ||
Voxtral Small Transcribe 3 | 2.1% | 42.7 | $4.00 | ||
Voxtral Mini Transcribe 3 | 2.2% | 62.4 | $3.50 | ||
Voxtral Mini Transcribe 2 | 3.6% | 95.2 | $3.00 | ||
Voxtral Small | 2.8% | 62.0 | $4.00 | ||
Voxtral Mini | 3.8% | 51.9 | $1.00 | ||
Modulate STT Batch English VFast | 4.2% | 40.3 | $0.42 | ||
Nemotron 3.5 Transcribe | 3.4% | 66.7 | $2.00 | ||
Parakeet TDT 0.6B V3, Togetherai | 4.5% | 614.3 | $1.50 | ||
Canary Qwen 2.5B, NVIDIA | 4.3% | 7.4 | $0.74 | ||
Parakeet TDT 0.6B V2, NVIDIA | 6.4% | 107.4 | $0.00 | ||
Parakeet RNNT 1.1B | 5.4% | 6.2 | $1.91 | ||
GPT Transcribe, OpenAI | 3.3% | 64.3 | $4.50 | ||
GPT-4o Transcribe | 4.0% | 41.5 | $6.00 | ||
GPT-4o Mini Transcribe | 4.5% | 71.3 | $3.00 | ||
Smallest AI Pulse Pro | 3.4% | 299.0 | $4.00 | ||
Rumble-2 | 2.7% | 305.4 | $22.25 | ||
Resonant-1 | 3.4% | 348.8 | $22.33 | ||
Rev AI | 5.9% | 33.1 | $3.33 | ||
Smallest AI Pulse | 3.3% | 237.3 | $3.00 | ||
Soniox v5 Async | 3.8% | 46.9 | $1.66 | ||
Speechmatics Melia | 4.9% | 182.6 | $4.00 | ||
Speechmatics Standard | 5.1% | 96.6 | $7.50 | ||
Speechmatics Enhanced | 4.0% | 60.1 | $12.50 | ||
StepAudio 2.5 ASR, StepFun | 4.7% | 135.4 | $0.37 | ||
StepAudio 3 ASR, StepFun | 2.5% | 84.5 | $6.67 | ||
Whisper Large v3 Turbo | 4.6% | 407.8 | $0.67 | ||
Whisper Large v3 Turbo, Telnyx | 5.5% | 32.1 | $15.00 | ||
Wizper Large v3 | 4.7% | 147.7 | $0.50 | ||
Incredibly Fast Whisper | 5.7% | 83.9 | $1.49 | ||
Whisper Large v3 | 10.1% | 2.7 | $4.23 | ||
Whisper Large v3 | 4.1% | 101.5 | $1.15 | ||
Whisper Large v3 | 4.5% | 282.7 | $1.50 | ||
Whisper Large v2 | 4.1% | 32.4 | $6.00 | ||
Zoom Scribe V2.1 Pro | 2.1% | 187.5 | $5.83 | ||
Zoom Scribe V2 Pro | 2.8% | 129.7 | $5.83 |