Codex vs. Devin Fusion CLI

Comparison between Codex and Devin Fusion CLI across the Artificial Analysis Coding Agent Index, including benchmark scores, cost, execution time, and token usage.

For details relating to our methodology, see our methodology page.

Explore other comparisons
vs

Coding Agent Index

Artificial Analysis Coding Agent Index v2.0 · Higher is better

Time per Task

Average agent wall time per task · Lower is better

Cost per Task

Average API cost per task (USD) · Lower is better

Comparison

Side-by-side comparison of Codex and Devin Fusion CLI.

Coding Agent Comparison

Metric
Codex
GPT-6 Astra (Max)
Devin Fusion CLI
Claude Opus 5.5 Max + GPT-6 Luna High
Analysis
Agent Harness
Codex
Devin Fusion CLI
Representative Model
GPT-6 Astra (Max)
Claude Opus 5.5 Max + GPT-6 Luna High
Coding Agent Index
55
62
Devin Fusion CLI has a higher Coding Agent Index than Codex
FrontierCode v1.1
49
54
Devin Fusion CLI has a higher FrontierCode v1.1 score than Codex
Terminal-Bench 4.0
56
63
Devin Fusion CLI has a higher Terminal-Bench 4.0 score than Codex
SWE-Atlas-QnA-AA
59
68
Devin Fusion CLI has a higher SWE-Atlas-QnA-AA score than Codex
Cost per Task
$7.04
$8.00
Codex has a lower cost per task than Devin Fusion CLI
Time per Task
24.8m
51.1m
Codex has a lower time per task than Devin Fusion CLI
Turns per Task
39.4
99.5
Codex has a lower turns per task than Devin Fusion CLI
Token Usage per Task
3.23M
10.5M
Codex has a lower token usage per task than Devin Fusion CLI
Cache Hit Rate
93%
87%
Codex has a higher cache hit rate than Devin Fusion CLI

Model Variants

Evaluated model variants for Codex and Devin Fusion CLI.

Model Variants

Codex
GPT-6 Astra (Max)
max
55
49
56
59
$7.04
24.8m
3.23M
Codex
GPT-6.1 Sol (Max)
max
54
49
53
60
$1.50
23.7m
3.94M
Codex
GPT-6.1 Terra (Xhigh)
xhigh
48
45
46
54
$0.69
16.4m
6.89M
Codex
GPT-6.1 Terra (Max)
max
48
42
48
54
$1.24
26.1m
12.3M
Codex
DeepSeek V4.1 Flash (Max)
max
47
53
28
61
$0.39
38.1m
27.2M
Codex
GPT-6.1 Terra (High)
high
46
43
42
53
$0.54
12.7m
5.6M
Codex
GPT-6.1 Terra (Medium)
medium
42
44
35
47
$0.39
10.2m
4.08M
Codex
GPT-6.1 Terra (Non-reasoning)
non-reasoning
39
46
25
46
$0.45
9.5m
5.78M
Codex
GPT-6.1 Terra (Low)
low
35
41
25
39
$0.20
6.3m
1.89M
Codex
GPT-6 Luna (Max)
max
31
40
16
38
$0.16
20.8m
8.69M
Devin Fusion CLI
Claude Opus 5.5 Max + GPT-6 Luna High
-
62
54
63
68
$8.00
51.1m
10.5M
Devin Fusion CLI
Claude Fable 5.1 XHigh + SWE-2 Medium
-
59
52
56
68
$8.20
37.6m
9.81M
Devin Fusion CLI
GPT-6 Astra XHigh + SWE-2 Medium
-
53
49
50
60
$4.34
21.2m
3.63M

Performance

Performance across the Artificial Analysis Coding Agent Index.

Artificial Analysis Coding Agent Index

Artificial Analysis Coding Agent Index v2.0 incorporates 3 benchmarks: FrontierCode v1.1, Terminal-Bench 4.0, and SWE-Atlas-QnA-AA · Higher is better
Color by

Artificial Analysis Coding Agent Index vs. Cost per Task

Artificial Analysis Coding Agent Index vs. average pay-per-token API cost per task (USD)
Color by
Most attractive quadrant
Pareto line

Token Usage

Token consumption across the Artificial Analysis Coding Agent Index.

Token Usage per Task

Average input, cache, and output tokens per task
Prompt cache hit rates can vary significantly by provider routing, which can materially change effective cost.

Artificial Analysis Coding Agent Index vs. Total Tokens

Artificial Analysis Coding Agent Index vs. average total tokens per task
Color by
Most attractive quadrant

Cost

Pay-per-token API cost across the Artificial Analysis Coding Agent Index, based on current per-token pricing.

Cost per Task

Average pay-per-token API cost per task (USD) · Lower is better
Color by

Execution Time

Active agent runtime across the Artificial Analysis Coding Agent Index.

Time per Task

Average agent wall time per task · Lower is better
Color by

Artificial Analysis Coding Agent Index vs. Execution Time

Artificial Analysis Coding Agent Index vs. average agent wall time per task
Color by
Most attractive quadrant