26 models

Meta Models: Intelligence, Performance & Price

Name: Artificial Analysis Intelligence Index
Creator: Artificial Analysis
License: https://artificialanalysis.ai/docs/legal/Terms-of-Use.pdf

Intelligence

Updated

Muse Wonder Full (max)

Muse Wonder (max)

Muse Wonder (high)

Muse Spark Open (xhigh)

Muse Glimmer (high)

Artificial Analysis Intelligence Index

Time per Task

Muse Glimmer (high)

4.6 min

Muse Spark Open (xhigh)

Per Intelligence Index Task

Cost

Muse Glimmer (high)

$0.16

Muse Spark Open (xhigh)

Per Intelligence Index Task

Artificial Analysis has benchmarked 26 models from Meta. Below is a comparison of the key metrics across these models.

For intelligence, the top model from Meta is Muse Wonder Full (Max) at 50.
For speed, Muse Glimmer (High) at 4.6 min has the lowest time per task.
For latency, Llama 4 Scout at 1.30s offers the lowest time to first answer token.
For pricing, Muse Glimmer (High) at $0.16 offers the lowest cost per task. Prices vary up to 43x across models.

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

No publicly available API

Artificial Analysis Intelligence Index v5.0.1 includes: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1. See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them.

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task

Most attractive quadrant

Pareto line

Weighted average cost per Intelligence Index task. Each evaluation’s cost is calculated from input, cache hit, cache write, reasoning, and answer token prices, divided by task count, and weighted by its Intelligence Index weight.

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Speed & Latency

Time per Intelligence Index Task

Output tokens divided by end-to-end output speed (minutes per Intelligence Index task) · Speed at the model's own endpoint or the median across providers · Lower is better

The weighted average time (minutes) per Artificial Analysis Intelligence Index task: output tokens per task divided by output speed, weighted by each benchmark's weight in the Intelligence Index.

Speed and latency metrics average each endpoint's runs over the past 5 days, and the error rate pools them. We run the benchmark every 6 hours, and endpoints of deprecated models every 18 hours.

Capability Scores

Capability Indexes

Measures the performance of models on specific capabilities and industries

Finance & Accounting Index

Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better

Strategy & Ops Index

Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better

Legal Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better

Healthcare & Medical Index

Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better

Engineering Index

Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode 2.0, AA-Briefcase v1.1 · Higher is better

Economics Index

Incorporates 4 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf · Higher is better

Further details

								Weights		Provider Benchmarks
Muse Wonder Full (Max)	Meta	50	-	1M	-	-	-	Not available	-	View
Muse Wonder (Max)	Meta	44	-	1M	$2.9	12.3	131	Not available		View
Muse Wonder (High)	Meta	41	-	1M	$2.9	8.9	127	Not available		View
Muse Spark 1.3 (Max)	Meta	37	-	1M	$0.8	12.0	127	Not available		View
Muse Spark Open (Xhigh)	Meta	25	816B 42B active at inference time	1M	$0.8	7.2	154	🤗	+4	View
Muse Glimmer (High)	Meta	6	30B	131k	$0.2	4.6	95	🤗		View
Muse Spark 1.2 (Xhigh)	Meta	-	-	1M	$0.8	-	170	Not available		View
Llama 3.1 Instruct 405B	Meta	-	405B	128k	-	-	-	🤗	-	View
Llama 3.1 Instruct 70B	Meta	-	70B	128k	$0.6	-	14	🤗		View
Llama 2 Chat 70B	Meta	-	70B	4k	-	-	-	🤗	-	View
Llama 3.2 Instruct 11B (Vision)	Meta	-	11B	128k	$0.3	-	20	🤗		View
Llama 2 Chat 13B	Meta	-	13B	4k	-	-	-	🤗	-	View
Llama 3.2 Instruct 3B	Meta	-	3B	128k	-	-	-	🤗	-	View
Llama 3.1 Instruct 8B	Meta	-	8B	128k	$0.0	-	123	🤗	+2	View
Llama 3.2 Instruct 1B	Meta	-	1B	128k	-	-	-	🤗	-	View
Llama 3 Instruct 8B	Meta	-	8B	8k	$0.1	-	46	🤗		View
Llama 4 Maverick	Meta	-	402B 17B active at inference time	1M	$0.3	-	66	🤗	+3	View
Llama 3.3 Instruct 70B	Meta	-	70B	128k	$0.6	-	76	🤗	+6	View
Llama 3.2 Instruct 90B (Vision)	Meta	-	90B	128k	-	-	-	🤗	-	View
Llama 3 Instruct 70B	Meta	-	70B	8k	$0.9	-	47	🤗		View
Llama 4 Scout	Meta	-	109B 17B active at inference time	10M	$0.2	-	87	🤗	+2	View
Muse Spark 1.3 (Xhigh)	Meta	-	-	1M	$0.8	-	225	Not available		View
Muse Spark 1.1 (Xhigh)	Meta	-	-	1M	$0.8	-	186	Not available		View
Muse Spark	Meta	-	-	262k	-	-	-	Not available	-	View
Llama 65B	Meta	-	65B	2k	-	-	-	🤗	-	View
Llama 2 Chat 7B	Meta	-	7B	4k	-	-	-	🤗	-	View

Meta Models: Intelligence, Performance & Price

Intelligence

Time per Task

Cost

IntelligenceUpdated

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index

Intelligence Index vs. Cost per Task

Cost per Intelligence Index Task

Artificial Analysis Intelligence Index

Cost

Cost per Intelligence Index Task

Cost per Intelligence Index Task

Speed & Latency

Time per Intelligence Index Task

Time per Intelligence Index Task

Time Period

Capability Scores

Capability Indexes

All Meta Releases

Further details