gpt-oss-120B (high): API Provider Benchmarking & Analysis
Analysis of API providers for gpt-oss-120B (high) across performance metrics including latency (time to first token), output speed (output tokens per second), price and others. API providers benchmarked include Cerebras, Databricks, Parasail, Cloudflare, Novita, Nebius Base, Baseten, Microsoft Azure, SambaNova, Eigen AI, Hyperbolic, Amazon Bedrock, Together.ai, Lightning AI, DeepInfra (Turbo), Google Vertex, Fireworks, Snowflake, Groq, Clarifai, DeepInfra.
Comparison Summary
Output Speed (tokens/s):
Cerebras (3135 t/s) and 
Fireworks (811 t/s) are the fastest providers of gpt-oss-120B (high), followed by 
Lightning AI (790 t/s), 
Together.ai (783 t/s) & 
Eigen AI (774 t/s).Latency (TTFT):
Groq (0.17s) and 
DeepInfra (Turbo) (0.22s) have the lowest latency for gpt-oss-120B (high), followed by 
Clarifai (0.25s), 
Google Vertex (0.25s) & Together.ai (0.25s).Blended Price ($/M tokens): DeepInfra ($0.08) and Google Vertex ($0.16) are the most cost-effective providers for gpt-oss-120B (high), followed by Clarifai ($0.16), Lightning AI ($0.17) & 
Novita ($0.20).Input Token Price: DeepInfra ($0.04) and Google Vertex ($0.09) offer the lowest input token prices for gpt-oss-120B (high), followed by Clarifai ($0.09), Novita ($0.10) & 
Baseten ($0.10).Output Token Price: DeepInfra ($0.19) and 
Snowflake ($0.22) offer the lowest output token prices for gpt-oss-120B (high), followed by 
Hyperbolic ($0.30), Google Vertex ($0.36) & Clarifai ($0.36).
Cerebras (3135 t/s) and Fireworks (811 t/s) are the fastest providers of gpt-oss-120B (high), followed by Lightning AI (790 t/s), Together.ai (783 t/s) & Eigen AI (774 t/s).Latency (TTFT): Groq (0.17s) and DeepInfra (Turbo) (0.22s) have the lowest latency for gpt-oss-120B (high), followed by Clarifai (0.25s), Google Vertex (0.25s) & Together.ai (0.25s).Blended Price ($/M tokens): DeepInfra ($0.08) and Google Vertex ($0.16) are the most cost-effective providers for gpt-oss-120B (high), followed by Clarifai ($0.16), Lightning AI ($0.17) & Novita ($0.20).Input Token Price: DeepInfra ($0.04) and Google Vertex ($0.09) offer the lowest input token prices for gpt-oss-120B (high), followed by Clarifai ($0.09), Novita ($0.10) & Baseten ($0.10).Output Token Price: DeepInfra ($0.19) and Snowflake ($0.22) offer the lowest output token prices for gpt-oss-120B (high), followed by Hyperbolic ($0.30), Google Vertex ($0.36) & Clarifai ($0.36).Highlights
Intelligence
Artificial Analysis Intelligence Index; Higher is better
