Laptop & workstation inference performance
We benchmark the local agent inference speeds that users can expect to get out of desk-scale hardware. Our official leaderboard consists of runs conducted in a controlled environment on Artificial Analysis' own hardware. In addition, our fully open-source AA-AgentPerf-Local tool enables any user to easily benchmark their own system's agentic performance.
Run your own local AI benchmarks using AA-AgentPerf-LocalSystems & models overview
We are currently testing on a limited set of systems and models, and expect these to expand significantly over time. A brief overview of each currently included system and model is included below.
Systems
MacBook Pro
M5 Pro · 64 GB · 20-core GPU
- Launch MSRP (64 GB)
- $3,000
- Memory
- 64 GB unified
- Memory bandwidth
- 307 GB/s
- Memory type
- LPDDR5X-9600
- Chip
- M5 Pro
- Launched
- Mar 2026
AMD Ryzen AI Halo
- Launch MSRP
- $4,000
- Memory
- 128 GB unified
- Memory bandwidth
- 256 GB/s
- Memory type
- LPDDR5X-8000
- Chip
- Ryzen AI Max+ 395
- Launched
- Jul 2026
NVIDIA DGX Spark
- Launch MSRP
- $4,000
- Memory
- 128 GB unified
- Memory bandwidth
- 273 GB/s
- Memory type
- LPDDR5X-8533
- Chip
- GB10
- Launched
- Oct 2025
NVIDIA RTX Spark N1X
20-core CPU · 6144-core GPU
- Launch MSRP (128 GB)
- $5,900
- Memory
- 128 GB unified
- Memory bandwidth
- 300 GB/s
- Memory type
- LPDDR5X-9400
- Chip
- N1X
- Launched
- Oct 2026
NVIDIA GeForce RTX 5090
- Launch MSRP (card)
- $2,000
- Memory
- 32 GB VRAM
- Memory bandwidth
- 1,792 GB/s
- Memory type
- GDDR7
- Chip
- RTX 5090
- Launched
- Jan 2025
Models
Qwen3.8 27B (Xhigh)
- Intelligence Index
- 34
- Total parameters
- 27B
- Active parameters
- 27B
- Context window
- 256K
- Released
- Aug 2026
- Builds tested
- Q4_K_M, UD-Q4_K_M
Qwen3.6 35B A3B (Reasoning)
- Intelligence Index
- 18
- Total parameters
- 36B
- Active parameters
- 3B
- Context window
- 256K
- Released
- Apr 2026
- Builds tested
- UD-Q4_K_M, NVFP4
Ling 3.0 Flash
- Intelligence Index
- 20
- Total parameters
- 124B
- Active parameters
- 5.1B
- Context window
- 256K
- Released
- Aug 2026
- Builds tested
- Q4_K_M
Results from all system & model combinations
Completion Time by Model and System
MacBook Pro (M5 Pro, 64 GB)64 GB unifiedAMD Ryzen AI Halo128 GB unifiedNVIDIA DGX Spark128 GB unifiedNVIDIA RTX Spark Laptop128 GB unifiedNVIDIA GeForce RTX 509032 GB VRAMPer-model results
Completion TimeQwen3.8 27B (Xhigh)
System prices
Systems are listed at approximate current prices (October 2026) by default, with launch MSRP under each name. Customize to better represent prices available to you.