Coding Agent Benchmarks

Kimi Code CLI vs. Mistral Vibe

Comparison between Kimi Code CLI and Mistral Vibe across the Artificial Analysis Coding Agent Index, including benchmark scores, cost, execution time, and token usage.

For details relating to our methodology, see our methodology page.

Explore other comparisons
vs
Artificial Analysis Coding Agent Index v2.1 · Higher is better
Average agent wall time per task · Lower is better
Average API cost per task (USD) · Lower is better

Comparison

Side-by-side comparison of Kimi Code CLI and Mistral Vibe.

Metric
Kimi K3.1 Pro
Mistral Large 4 (High)
Analysis
Agent Harness
Kimi Code CLI
Mistral Vibe
Representative Model
Kimi K3.1 Pro
Mistral Large 4 (High)
Coding Agent Index
49
41
Kimi Code CLI has a higher Coding Agent Index than Mistral Vibe
FrontierCode-AA 2.0
22
20
Kimi Code CLI has a higher FrontierCode-AA 2.0 score than Mistral Vibe
Terminal-Bench 4.1
67
42
Kimi Code CLI has a higher Terminal-Bench 4.1 score than Mistral Vibe
SWE-Atlas-QnA-AA
57
59
Mistral Vibe has a higher SWE-Atlas-QnA-AA score than Kimi Code CLI
Cost per Task
$2.94
$1.34
Mistral Vibe has a lower cost per task than Kimi Code CLI
Time per Task
41.8m
49.0m
Kimi Code CLI has a lower time per task than Mistral Vibe
Turns per Task
185.2
107.3
Mistral Vibe has a lower turns per task than Kimi Code CLI
Token Usage per Task
8.89M
9.42M
Kimi Code CLI has a lower token usage per task than Mistral Vibe
Cache Hit Rate
96%
92%
Kimi Code CLI has a higher cache hit rate than Mistral Vibe

Models

Evaluated models for Kimi Code CLI and Mistral Vibe.

Kimi K3.1 Pro
max
49
22
67
57
$2.94
41.8m
8.89M
Mistral Large 4 (High)
high
41
20
42
59
$1.34
49.0m
9.42M
Mistral Large 4 (Medium)
medium
30
18
26
45
$1.02
43.1m
7.73M

Performance

Performance across the Artificial Analysis Coding Agent Index.

Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index v2.1 incorporates 3 benchmarks: FrontierCode-AA 2.0, Terminal-Bench 4.1, and SWE-Atlas-QnA-AA · Higher is better
Color by

Artificial Analysis Coding Agent Index vs. Cost per Task

Artificial Analysis Coding Agent Index vs. average pay-per-token API cost per task (USD)
Color by
Most attractive quadrant
Pareto line

Token Usage

Token consumption across the Artificial Analysis Coding Agent Index.

Token Usage per Task

Average input, cache, and output tokens per task
Prompt cache hit rates can vary significantly by provider routing, which can materially change effective cost.

Artificial Analysis Coding Agent Index vs. Total Tokens

Artificial Analysis Coding Agent Index vs. average total tokens per task
Color by
Most attractive quadrant

Cost

Pay-per-token API cost across the Artificial Analysis Coding Agent Index, based on current per-token pricing.

Cost per Task

Average pay-per-token API cost per task (USD) · Lower is better
Color by

Execution Time

Active agent runtime across the Artificial Analysis Coding Agent Index.

Time per Task

Average agent wall time per task · Lower is better
Color by

Artificial Analysis Coding Agent Index vs. Execution Time

Artificial Analysis Coding Agent Index vs. average agent wall time per task
Color by
Most attractive quadrant