Granite 4.0 H Small Intelligence, Performance & Price Analysis
Model summary
Intelligence
Artificial Analysis Intelligence Index
Speed
Output tokens per second
Input Price
USD per 1M tokens
Output Price
USD per 1M tokens
Verbosity
Output tokens from Intelligence Index
Metrics are compared against models of the same class:
- Non-reasoning models → compared only with other non-reasoning models
- Reasoning models → compared across both reasoning and non-reasoning
- Open weights models → compared only with other open weights models of the same size class:
- Tiny: ≤4B parameters
- Small: 4B–40B parameters
- Medium: 40B–150B parameters
- Large: >150B parameters
- Proprietary models → compared across proprietary and open weights models of the same price range, using a blended 3:1 input/output price ratio:
- <$0.15 per 1M tokens
- $0.15–$1 per 1M tokens
- >$1 per 1M tokens
| Reasoning | No This page shows the non-reasoning version of this model. A reasoning variant may also exist. |
|---|---|
| Input modality | Supports: text |
| Output modality | Supports: text |
| Context window | 128k ~192 A4 pages of size 12 Arial font |
| Total parameters | 32B |
| Active parameters | 9B Number of parameters active per token during inference |
| License | Apache 2.0 |
| Model weights | Hugging Face |
Granite 4.0 H Small is above average in intelligence, but somewhat expensive when comparing to other open weight non-reasoning models of similar size. It's also notably fast and fairly concise. The model supports text input, outputs text, and has a 128k tokens context window.
Granite 4.0 H Small scores 11 on the Artificial Analysis Intelligence Index, placing it above average among comparable models (averaging 11). When evaluating the Intelligence Index, it generated 2.3M tokens, which is fairly concise in comparison to the average of 4.5M.
Pricing for Granite 4.0 H Small is $0.06 per 1M input tokens (somewhat expensive, average: $0.06) and $0.25 per 1M output tokens (somewhat expensive, average: $0.18). In total, it cost $4.48 to evaluate Granite 4.0 H Small on the Intelligence Index.
At 395 tokens per second, Granite 4.0 H Small is notably fast (106).
Intelligence
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index by Open Weights / Proprietary
Intelligence Evaluations
Openness
Artificial Analysis Openness Index: Results
Intelligence Index Comparisons
Intelligence vs. Price
Intelligence Index Token Use & Cost
Output Tokens Used to Run Artificial Analysis Intelligence Index
Cost to Run Artificial Analysis Intelligence Index
Context Window
Context Window
Pricing
Pricing: Input and Output Prices
Intelligence vs. Price (Log Scale)
Pricing Comparison of Granite 4.0 H Small API Providers
Speed
Measured by Output Speed (tokens per second)
Output Speed
Output Speed vs. Price
Latency
Measured by Time (seconds) to First Token
Latency: Time To First Answer Token
End-to-End Response Time
Seconds to output 500 Tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed
End-to-End Response Time
Model Size (Open Weights Models Only)
Model Size: Total and Active Parameters
Frequently Asked Questions
Common questions about Granite 4.0 H Small
Granite 4.0 H Small was released on September 22, 2025.
Granite 4.0 H Small was created by IBM.
Granite 4.0 H Small scores 11 on the Artificial Analysis Intelligence Index, placing it above average among other open weight non-reasoning models of similar size (median: 11).
Granite 4.0 H Small generates output at 394.6 tokens per second (based on the median across providers serving the model), which is well above average compared to other open weight non-reasoning models of similar size (median: 105.7 t/s).
Granite 4.0 H Small has a time to first token (TTFT) of 10.31s (based on the median across providers serving the model), which is at the higher end compared to other open weight non-reasoning models of similar size (median: 1.44s).
Granite 4.0 H Small costs $0.06 per 1M input tokens (very competitive, median: $0.15) and $0.25 per 1M output tokens (better than average, median: $0.30), based on the median across providers serving the model.
Granite 4.0 H Small costs $0.06 per 1M input tokens and $0.25 per 1M output tokens (based on the median across providers serving the model). For a blended rate (3:1 input to output ratio), this is $0.11 per 1M tokens. Pricing may vary by provider. Compare provider pricing
When evaluated on the Intelligence Index, Granite 4.0 H Small generated 2.3M output tokens, which is better than average compared to other open weight non-reasoning models of similar size (median: 4.5M).
No, Granite 4.0 H Small is not a reasoning model. It provides direct responses without extended chain-of-thought reasoning.
Granite 4.0 H Small supports text input.
Granite 4.0 H Small supports text output.
No, Granite 4.0 H Small does not support image input. It can only process text.
No, Granite 4.0 H Small is not multimodal. It only supports text input.
Granite 4.0 H Small has a context window of 130k tokens. This determines how much text and conversation history the model can process in a single request.
Yes, Granite 4.0 H Small is open weights. The model weights are publicly available and can be downloaded for self-hosting.
Granite 4.0 H Small has 32 billion parameters (9 billion active).
Granite 4.0 H Small is a Mixture of Experts (MoE) model with 32 billion total parameters, but only 9 billion active parameters are used during inference.
Granite 4.0 H Small is released under the Apache 2.0 license. This license allows commercial use. View license
Granite 4.0 H Small achieves a score of 11 on the Artificial Analysis Intelligence Index. This composite benchmark evaluates models across reasoning, knowledge, mathematics, and coding.
Yes, Granite 4.0 H Small is available via API through 1 provider. Compare API providers
Granite 4.0 H Small is available through 1 API provider. Compare providers