Groq: Models Intelligence, Performance & Price
This analysis is intended to support you in choosing the best model provided by Groq for your use-case.
Most Intelligent
gpt-oss-120b (high)gpt-oss-120b (low)gpt-oss-20b (low)gpt-oss-20b (high)
Llama 3.3 70BIntelligence Index
Total 6 models
Fastest
gpt-oss-20b (high)gpt-oss-20b (low)Llama 3.1 8Bgpt-oss-120b (high)gpt-oss-120b (low)Output speed
Total 6 models
Lowest Price
Llama 3.1 8Bgpt-oss-20b (low)gpt-oss-20b (high)gpt-oss-120b (high)gpt-oss-120b (low)Blended price (per 1M tokens)
Total 6 models
Groq offers 6 models, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across models.
- For intelligence, the top models on Groq are gpt-oss-120b (high) (12), gpt-oss-120b (low) (10), and gpt-oss-20b (low) (10).
- For output speed, the fastest models are gpt-oss-20b (high) (957 t/s), gpt-oss-20b (low) (943 t/s), and Llama 3.1 8B (645 t/s). Speed varies significantly across models, with a 103% difference between the fastest and slowest.
- For latency, Llama 3.1 8B (0.78s), Llama 3.3 70B (0.91s), and gpt-oss-20b (high) (2.85s) offer the lowest time to first answer token.
- For pricing, Llama 3.1 8B ($0.05), gpt-oss-20b (low) ($0.10), and gpt-oss-20b (high) ($0.10) offer the lowest blended prices per 1M tokens. Prices vary up to 3.7x across models.
- For context window size, gpt-oss-120b (high) (131k), gpt-oss-120b (low) (131k), and gpt-oss-20b (low) (131k) support the largest context windows on Groq.
Intelligence Evaluations
Artificial Analysis Intelligence Index
Intelligence Evaluations
Agentic knowledge work, (Elo-500)/2000
Agentic real-world work tasks, (Elo-500)/2000
Agentic SaaS workflows
Agentic coding & terminal use
Coding
Reasoning & knowledge
Professional document reasoning, All-pass
Physics reasoning
Knowledge
1 - hallucination rate
Long context reasoning
Legal agentic work, Hallucination-Gated All-Pass Rate
Agentic business operations
Agentic scientific research workflows in a terminal
Agentic software engineering in open-source repositories
Quantitative analysis on spreadsheets & documents
Kubernetes incident root-cause analysis
Visual reasoning
Medical long context reasoning
Intelligence Index vs. Price
Context Window
Context Window
Pricing
Intelligence Index vs. Price
Performance Summary
Output Speed vs. Price
Speed
Measured by Output Speed (tokens per second)
Output Speed
Latency
Measured by Time (seconds) to First Token
Latency: Time To First Answer Token
End-to-End Response Time
Seconds to output 500 tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed
End-to-End Response Time vs. Price
Further Analysis | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
gpt-oss-120b (high) | 131k | Open | 12 | -- | 474 | 0.63 | 5.91 | 4.22 | |||
gpt-oss-120b (low) | 131k | Open | 10* | -- | 473 | 0.71 | 6.00 | 4.23 | |||
gpt-oss-20b (low) | 131k | Open | 10* | -- | 943 | 0.75 | 3.40 | 2.12 | |||
gpt-oss-20b (high) | 131k | Open | 9 | $0.02 | 957 | 0.77 | 3.38 | 2.09 | |||
Llama 3.3 70B | 131k | Open | 8* | -- | 303 | 0.91 | 2.56 | -- | |||
Llama 3.1 8B | 131k | Open | 7* | -- | 645 | 0.78 | 1.56 | -- | |||
Key definitions
Frequently Asked Questions
Common questions about Groq
Groq offers 6 models that we track: gpt-oss-120b (high), gpt-oss-120b (low), gpt-oss-20b (low), gpt-oss-20b (high), Llama 3.3 70B, and Llama 3.1 8B.
The most intelligent model available on Groq is gpt-oss-120b (high) with an Intelligence Index score of 12.
The fastest model on Groq by output speed is gpt-oss-20b (high) at 956.8 tokens per second.
The model with the lowest time to first answer token on Groq is Llama 3.1 8B at 0.78s. Lower latency means faster initial response time.
The most affordable model on Groq by blended price is Llama 3.1 8B at $0.05 per 1M tokens (7:2:1 cache hit/input/output ratio).
Prices on Groq vary up to 12x across models, from $0.05 per 1M tokens for Llama 3.1 8B to $0.61 per 1M tokens for Llama 3.3 70B.
Yes, Groq offers an OpenAI-compatible API, making it easy to switch from OpenAI or use existing OpenAI SDK integrations.
Yes, all 6 models on Groq support JSON mode for structured output.
Yes, all 6 models on Groq support function calling (tool use).
Yes, Groq offers 4 reasoning models: gpt-oss-120b (high), gpt-oss-120b (low), gpt-oss-20b (low), and gpt-oss-20b (high). Reasoning models use extended thinking to work through complex problems before providing an answer.
Yes, all 6 models on Groq are open weight models.
Yes, provider performance can vary over time due to infrastructure changes, load balancing, and updates. We continuously benchmark all providers and display historical performance trends in the "Over Time" charts.
When choosing a model on Groq, consider: intelligence (for quality-sensitive tasks), output speed (for throughput-intensive tasks), latency (for interactive applications requiring quick first responses), pricing (for cost-sensitive workloads), and features like context window size, JSON mode, or function calling support.