Codex vs. Mirror
Comparison between Codex and Mirror across the Artificial Analysis Coding Agent Index, including benchmark scores, cost, execution time, and token usage.
For details relating to our methodology, see our methodology page.
Explore other comparisons
vs
Comparison
Side-by-side comparison of Codex and Mirror.
Coding Agent Comparison
Metric |  CodexGPT-6 Astra (Max) |  MirrorBeam 1.0 | Analysis |
|---|---|---|---|
Agent Harness | Codex | Mirror | |
Representative Model | GPT-6 Astra (Max) | Beam 1.0 | |
Coding Agent Index | 55 | 20 | Codex has a higher Coding Agent Index than Mirror |
FrontierCode v1.1 | 49% | 20% | Codex has a higher FrontierCode v1.1 score than Mirror |
Terminal-Bench 4.0 | 56% | 4% | Codex has a higher Terminal-Bench 4.0 score than Mirror |
SWE-Atlas-QnA-AA | 59% | 38% | Codex has a higher SWE-Atlas-QnA-AA score than Mirror |
Cost per Task | $7.04 | $0.32 | Mirror has a lower cost per task than Codex |
Time per Task | 24.8m | 38.7m | Codex has a lower time per task than Mirror |
Turns per Task | 39.4 | 93 | Codex has a lower turns per task than Mirror |
Token Usage per Task | 3.23M | 4.89M | Codex has a lower token usage per task than Mirror |
Cache Hit Rate | 93% | 95% | Mirror has a higher cache hit rate than Codex |
Model Variants
Evaluated model variants for Codex and Mirror.
Model Variants
| Codex | GPT-6 Astra (Max) | max | 55 | 49% | 56% | 59% | $7.04 | 24.8m | 3.23M |
| Codex | GPT-6.1 Sol (Max) | max | 54 | 49% | 53% | 60% | $1.50 | 23.7m | 3.94M |
| Codex | GPT-6.1 Terra (Xhigh) | xhigh | 48 | 45% | 46% | 54% | $0.69 | 16.4m | 6.89M |
| Codex | GPT-6.1 Terra (Max) | max | 48 | 42% | 48% | 54% | $1.24 | 26.1m | 12.3M |
| Codex |  DeepSeek V4.1 Flash (Max) | max | 47 | 53% | 28% | 61% | $0.39 | 38.1m | 27.2M |
| Codex | GPT-6.1 Terra (High) | high | 46 | 43% | 42% | 53% | $0.54 | 12.7m | 5.6M |
| Codex | GPT-6.1 Terra (Medium) | medium | 42 | 44% | 35% | 47% | $0.39 | 10.2m | 4.08M |
| Codex | GPT-6.1 Terra (Non-reasoning) | non-reasoning | 39 | 46% | 25% | 46% | $0.45 | 9.5m | 5.78M |
| Codex | GPT-6.1 Terra (Low) | low | 35 | 41% | 25% | 39% | $0.20 | 6.3m | 1.89M |
| Codex | GPT-6 Luna (Max) | max | 31 | 40% | 16% | 38% | $0.16 | 21.3m | 8.89M |
| Mirror | Beam 1.0 | reasoning | 20 | 20% | 4% | 38% | $0.32 | 38.7m | 4.89M |
Performance
Performance across the Artificial Analysis Coding Agent Index.
Artificial Analysis Coding Agent Index
Artificial Analysis Coding Agent Index v2.0 incorporates 3 benchmarks: FrontierCode v1.1, Terminal-Bench 4.0, and SWE-Atlas-QnA-AA · Higher is better
Color by
Artificial Analysis Coding Agent Index vs. Cost per Task
Artificial Analysis Coding Agent Index vs. average pay-per-token API cost per task (USD)
Color by
Most attractive quadrant
Pareto line
Token Usage
Token consumption across the Artificial Analysis Coding Agent Index.
Token Usage per Task
Average input, cache, and output tokens per task
Prompt cache hit rates can vary significantly by provider routing, which can materially change effective cost.
Artificial Analysis Coding Agent Index vs. Total Tokens
Artificial Analysis Coding Agent Index vs. average total tokens per task
Color by
Most attractive quadrant
Cost
Pay-per-token API cost across the Artificial Analysis Coding Agent Index, based on current per-token pricing.
Cost per Task
Average pay-per-token API cost per task (USD) · Lower is better
Color by
Execution Time
Active agent runtime across the Artificial Analysis Coding Agent Index.
Time per Task
Average agent wall time per task · Lower is better
Color by
Artificial Analysis Coding Agent Index vs. Execution Time
Artificial Analysis Coding Agent Index vs. average agent wall time per task
Color by
Most attractive quadrant