Coding Agent Benchmarks

Grok Build vs. Mistral Vibe

Comparison between Grok Build and Mistral Vibe across the Artificial Analysis Coding Agent Index, including benchmark scores, cost, execution time, and token usage.

For details relating to our methodology, see our methodology page.

Explore other comparisons
vs
Artificial Analysis Coding Agent Index v2.1 · Higher is better
Average agent wall time per task · Lower is better
Average API cost per task (USD) · Lower is better

Comparison

Side-by-side comparison of Grok Build and Mistral Vibe.

Metric
Grok 4.7 (Xhigh)
Mistral Large 4 (High)
Analysis
Agent Harness
Grok Build
Mistral Vibe
Representative Model
Grok 4.7 (Xhigh)
Mistral Large 4 (High)
Coding Agent Index
42
41
Grok Build has a higher Coding Agent Index than Mistral Vibe
FrontierCode-AA 2.0
30
20
Grok Build has a higher FrontierCode-AA 2.0 score than Mistral Vibe
Terminal-Bench 4.1
32
42
Mistral Vibe has a higher Terminal-Bench 4.1 score than Grok Build
SWE-Atlas-QnA-AA
63
59
Grok Build has a higher SWE-Atlas-QnA-AA score than Mistral Vibe
Cost per Task
$15.35
$1.34
Mistral Vibe has a lower cost per task than Grok Build
Time per Task
36.6m
49.0m
Grok Build has a lower time per task than Mistral Vibe
Turns per Task
174.2
107.3
Mistral Vibe has a lower turns per task than Grok Build
Token Usage per Task
17.1M
9.42M
Mistral Vibe has a lower token usage per task than Grok Build
Cache Hit Rate
95%
92%
Grok Build has a higher cache hit rate than Mistral Vibe

Models

Evaluated models for Grok Build and Mistral Vibe.

Grok 4.7 (Xhigh)
xhigh
42
30
32
63
$15.35
36.6m
17.1M
Mistral Large 4 (High)
high
41
20
42
59
$1.34
49.0m
9.42M
Mistral Large 4 (Medium)
medium
30
18
26
45
$1.02
43.1m
7.73M

Performance

Performance across the Artificial Analysis Coding Agent Index.

Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index v2.1 incorporates 3 benchmarks: FrontierCode-AA 2.0, Terminal-Bench 4.1, and SWE-Atlas-QnA-AA · Higher is better
Color by

Artificial Analysis Coding Agent Index vs. Cost per Task

Artificial Analysis Coding Agent Index vs. average pay-per-token API cost per task (USD)
Color by
Most attractive quadrant
Pareto line

Token Usage

Token consumption across the Artificial Analysis Coding Agent Index.

Token Usage per Task

Average input, cache, and output tokens per task
Prompt cache hit rates can vary significantly by provider routing, which can materially change effective cost.

Artificial Analysis Coding Agent Index vs. Total Tokens

Artificial Analysis Coding Agent Index vs. average total tokens per task
Color by
Most attractive quadrant

Cost

Pay-per-token API cost across the Artificial Analysis Coding Agent Index, based on current per-token pricing.

Cost per Task

Average pay-per-token API cost per task (USD) · Lower is better
Color by

Execution Time

Active agent runtime across the Artificial Analysis Coding Agent Index.

Time per Task

Average agent wall time per task · Lower is better
Color by

Artificial Analysis Coding Agent Index vs. Execution Time

Artificial Analysis Coding Agent Index vs. average agent wall time per task
Color by
Most attractive quadrant