Coding Agent Benchmarks

Claude Code vs. Devin Fusion CLI

Comparison between Claude Code and Devin Fusion CLI across the Artificial Analysis Coding Agent Index, including benchmark scores, cost, execution time, and token usage.

For details relating to our methodology, see our methodology page.

Explore other comparisons
vs

Coding Agent Index

Artificial Analysis Coding Agent Index v2.0 · Higher is better

Time per Task

Average agent wall time per task · Lower is better

Cost per Task

Average API cost per task (USD) · Lower is better

Comparison

Side-by-side comparison of Claude Code and Devin Fusion CLI.

Metric
Claude Code
Claude Opus 5.5 (Max, Default Fallback)
Devin Fusion CLI
Claude Opus 5.5 Max + GPT-6 Luna High
Analysis
Agent Harness
Claude Code
Devin Fusion CLI
Representative Model
Claude Opus 5.5 (Max, Default Fallback)
Claude Opus 5.5 Max + GPT-6 Luna High
Coding Agent Index
62
62
Both agents have the same Coding Agent Index
FrontierCode v1.1
56
54
Claude Code has a higher FrontierCode v1.1 score than Devin Fusion CLI
Terminal-Bench 4.0
63
63
Both agents have the same Terminal-Bench 4.0 score
SWE-Atlas-QnA-AA
66
68
Devin Fusion CLI has a higher SWE-Atlas-QnA-AA score than Claude Code
Cost per Task
$11.42
$8.00
Devin Fusion CLI has a lower cost per task than Claude Code
Time per Task
1.0h
51.1m
Devin Fusion CLI has a lower time per task than Claude Code
Turns per Task
146.4
99.5
Devin Fusion CLI has a lower turns per task than Claude Code
Token Usage per Task
14.5M
10.5M
Devin Fusion CLI has a lower token usage per task than Claude Code
Cache Hit Rate
95%
87%
Claude Code has a higher cache hit rate than Devin Fusion CLI

Model Variants

Evaluated model variants for Claude Code and Devin Fusion CLI.

Claude Code
Claude Opus 5.5 (Max, Default Fallback)
max
62
56
63
66
$11.42
1.0h
14.5M
Claude Code
Claude Sonnet 5.5 (Max, Default Fallback)
max
59
48
66
64
$13.30
1.3h
24.1M
Claude Code
Claude Fable 5.1 (Max, Default Fallback)
max
58
49
58
66
$11.53
35.3m
5.99M
Claude Code
Step 5 Preview
reasoning
43
40
30
59
$1.84
1.0h
22.1M
Claude Code
Qwen3.8 Max
reasoning
39
45
17
56
$3.80
1.3h
9.15M
Claude Code
Claude Haiku 5.5 (Max)
max
37
47
31
34
$2.67
1.2h
16.1M
Devin Fusion CLI
Claude Opus 5.5 Max + GPT-6 Luna High
-
62
54
63
68
$8.00
51.1m
10.5M
Devin Fusion CLI
Claude Fable 5.1 XHigh + SWE-2 Medium
-
59
52
56
68
$8.20
37.6m
9.81M
Devin Fusion CLI
GPT-6 Astra XHigh + SWE-2 Medium
-
53
49
50
60
$4.34
21.2m
3.63M

Performance

Performance across the Artificial Analysis Coding Agent Index.

Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index v2.0 incorporates 3 benchmarks: FrontierCode v1.1, Terminal-Bench 4.0, and SWE-Atlas-QnA-AA · Higher is better
Color by

Artificial Analysis Coding Agent Index vs. Cost per Task

Artificial Analysis Coding Agent Index vs. average pay-per-token API cost per task (USD)
Color by
Most attractive quadrant
Pareto line

Token Usage

Token consumption across the Artificial Analysis Coding Agent Index.

Token Usage per Task

Average input, cache, and output tokens per task
Prompt cache hit rates can vary significantly by provider routing, which can materially change effective cost.

Artificial Analysis Coding Agent Index vs. Total Tokens

Artificial Analysis Coding Agent Index vs. average total tokens per task
Color by
Most attractive quadrant

Cost

Pay-per-token API cost across the Artificial Analysis Coding Agent Index, based on current per-token pricing.

Cost per Task

Average pay-per-token API cost per task (USD) · Lower is better
Color by

Execution Time

Active agent runtime across the Artificial Analysis Coding Agent Index.

Time per Task

Average agent wall time per task · Lower is better
Color by

Artificial Analysis Coding Agent Index vs. Execution Time

Artificial Analysis Coding Agent Index vs. average agent wall time per task
Color by
Most attractive quadrant