Meta has launched a newer model, Llama 3.1 8B, we suggest considering this model instead.
For more information, see Comparison of Llama 3.1 8B to other models and API provider benchmarks for Llama 3.1 8B.
Llama 3 Instruct 8B Intelligence, Performance & Price Analysis
Model summary
Intelligence
Artificial Analysis Intelligence Index
Speed
Output tokens per second
Input Price
USD per 1M tokens
Output Price
USD per 1M tokens
Verbosity
Output tokens from Intelligence Index
Llama 3 Instruct 8B is among the least intelligent models, but reasonably priced when comparing to other open weight non-reasoning models of similar size. The model has a 8k tokens context window with knowledge up to March 2023.
Llama 3 Instruct 8B scores 6 on the Artificial Analysis Intelligence Index, placing it at the lower end among comparable models (averaging 11). When evaluating the Intelligence Index, it generated 2.2M tokens, which is very concise in comparison to the average of 8.5M.
Pricing for Llama 3 Instruct 8B is $0.04 per 1M input tokens (moderately priced, average: $0.05) and $0.14 per 1M output tokens (moderately priced, average: $0.15). In total, it cost $0.74 to evaluate Llama 3 Instruct 8B on the Intelligence Index.
| Reasoning | No This page shows the non-reasoning version of this model. A reasoning variant may also exist. |
|---|---|
| Input modality | Supports: This information is still being updated |
| Output modality | This information is still being updated |
| Knowledge cutoff | Mar 1, 2023 |
| Context window | 8k ~12 A4 pages of size 12 Arial font |
| Total parameters | 8B |
| License | META LLAMA 3 COMMUNITY LICENSE AGREEMENT |
| Model weights | Hugging Face |
Metrics are compared against models of the same class:
- Non-reasoning models → compared only with other non-reasoning models
- Reasoning models → compared across both reasoning and non-reasoning
- Open weights models → compared only with other open weights models of the same size class:
- Tiny: ≤4B parameters
- Small: 4B–40B parameters
- Medium: 40B–150B parameters
- Large: >150B parameters
- Proprietary models → compared across proprietary and open weights models of the same price range, using a blended 3:1 input/output price ratio:
- <$0.15 per 1M tokens
- $0.15–$1 per 1M tokens
- >$1 per 1M tokens
Highlights
Intelligence
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index by Open Weights / Proprietary
Intelligence Evaluations
Openness
Artificial Analysis Openness Index: Results
Intelligence Index Comparisons
Intelligence vs. Price
Intelligence Index Token Use & Cost
Output Tokens Used to Run Artificial Analysis Intelligence Index
Cost to Run Artificial Analysis Intelligence Index
Context Window
Context Window
Pricing
Pricing: Input and Output Prices
Intelligence vs. Price (Log Scale)
Pricing Comparison of Llama 3 Instruct 8B API Providers
Speed
Measured by Output Speed (tokens per second)
Output Speed
Output Speed vs. Price
Latency
Measured by Time (seconds) to First Token
Latency: Time To First Answer Token
End-to-End Response Time
Seconds to output 500 Tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed
End-to-End Response Time
Model Size (Open Weights Models Only)
Model Size: Total and Active Parameters
Frequently Asked Questions
Common questions about Llama 3 Instruct 8B
Llama 3 Instruct 8B was released on April 18, 2024.
Llama 3 Instruct 8B was created by Meta.
Llama 3 Instruct 8B scores 6 on the Artificial Analysis Intelligence Index, placing it at the lower end among other open weight non-reasoning models of similar size (median: 11).
Llama 3 Instruct 8B costs $0.04 per 1M input tokens (very competitive, median: $0.15) and $0.14 per 1M output tokens (very competitive, median: $0.30), based on the median across providers serving the model.
Llama 3 Instruct 8B costs $0.04 per 1M input tokens and $0.14 per 1M output tokens (based on the median across providers serving the model). For a blended rate (3:1 input to output ratio), this is $0.07 per 1M tokens. Pricing may vary by provider. Compare provider pricing
When evaluated on the Intelligence Index, Llama 3 Instruct 8B generated 2.2M output tokens, which is very competitive compared to other open weight non-reasoning models of similar size (median: 8.5M).
No, Llama 3 Instruct 8B is not a reasoning model. It provides direct responses without extended chain-of-thought reasoning.
Llama 3 Instruct 8B supports text only input.
Llama 3 Instruct 8B supports text only output.
No, Llama 3 Instruct 8B does not support image input. It can only process text.
No, Llama 3 Instruct 8B is not multimodal. It only supports text only input.
Llama 3 Instruct 8B has a context window of 8.2k tokens. This determines how much text and conversation history the model can process in a single request.
Yes, Llama 3 Instruct 8B is open weights. The model weights are publicly available and can be downloaded for self-hosting.
Llama 3 Instruct 8B has 8 billion parameters.
Llama 3 Instruct 8B is released under the META LLAMA 3 COMMUNITY LICENSE AGREEMENT license. This license allows commercial use. View license
Llama 3 Instruct 8B achieves a score of 6 on the Artificial Analysis Intelligence Index. This composite benchmark evaluates models across reasoning, knowledge, mathematics, and coding.
Llama 3 Instruct 8B has a knowledge cutoff of March 2023. The model's training data includes information up to this date.
Yes, Llama 3 Instruct 8B is available via API through 4 providers. Compare API providers
Llama 3 Instruct 8B is available through 4 API providers. Compare providers