> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [site/content/finding-pages.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/site/content/finding-pages.json)
- [reproduce/lab-aor-kogen-c7-round2-20261107/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/lab-aor-kogen-c7-round2-20261107/README.md)
- [reproduce/hk2-hard-set-grading-correction/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/hk2-hard-set-grading-correction/README.md)
- [reproduce/hard-tasks-grading-correction/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/hard-tasks-grading-correction/README.md)
- [reproduce/hk4-lm-hard-tasks/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/hk4-lm-hard-tasks/README.md)
- [reproduce/hk3-mb-hard-tasks/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/hk3-mb-hard-tasks/README.md)
- [reproduce/hk3-lm-hard-tasks/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/hk3-lm-hard-tasks/README.md)
- [reproduce/hk2-hard-set/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/hk2-hard-set/README.md)
- [reproduce/hard-task-review-value/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/hard-task-review-value/README.md)
- [reproduce/ccs3-lm-hard-tasks/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/ccs3-lm-hard-tasks/README.md)
- [reproduce/ccs2-mb-hard-tasks/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/ccs2-mb-hard-tasks/README.md)
- [reproduce/cco-mb-hard-tasks/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/cco-mb-hard-tasks/README.md)

# Kogen vs the same agent used alone, on hard tasks

Tests of the full Kogen product, which drives another coding agent, against that agent used on its own, on hard multi-step repository tasks.

## Results, newest first

| Result | Verdict | Finished |
| --- | --- | --- |
| [Kogen with the shaping fix against Claude Code alone on five Rails tasks (smoke, round 2)](/findings/lab-aor-kogen-c7-round2-20261107/) | Unresolved | 7 November 2026 |
| [Correction: three of the nine chosen hard tasks were chosen because of a grader defect](/findings/hk2-hard-set-grading-correction/) | Yes | 1 November 2026 |
| [Correction: how the grader affected the five hard-task results](/findings/hard-tasks-grading-correction/) | Yes | 31 October 2026 |
| [A newer Kogen driving Codex vs Codex alone: tied on the tasks that could be graded](/findings/hk4-lm-hard-tasks/) | Unresolved | 30 October 2026 |
| [Kogen driving Codex vs Codex alone, 6 hard tasks, one MacBook: tied on success](/findings/hk3-mb-hard-tasks/) | Unresolved | 30 October 2026 |
| [Kogen driving Codex vs Codex alone, 9 hard tasks, one laptop: tied on success](/findings/hk3-lm-hard-tasks/) | Unresolved | 30 October 2026 |
| [Choosing hard tasks for Kogen against Codex alone](/findings/hk2-hard-set/) | Unresolved | 30 October 2026 |
| [What Kogen's independent review step did in hard-task runs](/findings/hard-task-review-value/) | Unresolved | 30 October 2026 |
| [Kogen driving Claude Code vs Claude Code alone, 9 hard tasks, one laptop](/findings/ccs3-lm-hard-tasks/) | Unresolved | 30 October 2026 |
| [Kogen driving Claude Code vs Claude Code alone, 6 hard tasks, one MacBook, second block](/findings/ccs2-mb-hard-tasks/) | Unresolved | 30 October 2026 |
| [Kogen driving Claude Code vs Claude Code alone, 6 hard tasks, one MacBook](/findings/cco-mb-hard-tasks/) | Unresolved | 30 October 2026 |
