Mixtral 8x22B: API Provider Benchmarking & Analysis
Analysis of API providers for Mixtral 8x22B Instruct across performance metrics including latency (time to first token), output speed (output tokens per second), price and others. API providers benchmarked include Mistral and Fireworks.
Comparison Summary
Output Speed (tokens/s): Mistral (54 t/s) is the fastest provider of Mixtral 8x22B, followed by 
Fireworks (47 t/s).Latency (TTFT): Mistral (0.37s) has the lowest latency for Mixtral 8x22B, followed by Fireworks (0.38s).Blended Price ($/M tokens): Fireworks ($1.20) is the lowest price provider of Mixtral 8x22B with an Input Token Price of $1.20 and an Output Token Price of $1.20, followed by Mistral ($3.00).Input Token Price: Fireworks ($1.20) and Mistral ($2.00) offer the lowest input token prices for Mixtral 8x22B.Output Token Price: Fireworks ($1.20) and Mistral ($6.00) offer the lowest output token prices for Mixtral 8x22B.
Mistral (54 t/s) is the fastest provider of Mixtral 8x22B, followed by Fireworks (47 t/s).Latency (TTFT): Mistral (0.37s) has the lowest latency for Mixtral 8x22B, followed by Fireworks (0.38s).Blended Price ($/M tokens): Fireworks ($1.20) is the lowest price provider of Mixtral 8x22B with an Input Token Price of $1.20 and an Output Token Price of $1.20, followed by Mistral ($3.00).Input Token Price: Fireworks ($1.20) and Mistral ($2.00) offer the lowest input token prices for Mixtral 8x22B.Output Token Price: Fireworks ($1.20) and Mistral ($6.00) offer the lowest output token prices for Mixtral 8x22B.Highlights
Intelligence
Artificial Analysis Intelligence Index; Higher is better
Estimate (independent evaluation forthcoming)
