> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [rounds/core4-pilots/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/core4-pilots/README.md)
- [results/run-records/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/run-records/index.json)
- [rounds/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/index.json)
- [results/source-crosswalk/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/source-crosswalk/index.json)
- [rounds/STATUS.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/STATUS.md)
- [reproduce/round-inventory.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/round-inventory.json)

# Core4 pilots

**Round ID:** core4-pilots  
**Status:** DESCRIPTIVE

> Reviewed status from rounds/STATUS.md: DESCRIPTIVE.

> Round README and results text are source material. Numeric values not tied to a claim ledger record remain source-reported.

This round compared Rust, Go, and TypeScript/Bun; descriptive full passes by language (Go, Rust, TS/Bun) were go 3/4, rust 3/4, ts-bun 4/4. The results are descriptive and establish no language decision.

Round date: 2026-10-09
Publication badge: DESCRIPTIVE; KEPT FOR AUDIT
Why not VALID: Required execution metadata was not captured, so these results are descriptive and support no language ranking. Registered reasons: DESCRIPTIVE_ONLY, RAW_EVIDENCE_PARTIAL.
Recomputation status: OBSERVED SOURCE ONLY
Label: DESCRIPTIVE
STATUS: **DESCRIPTIVE**

## How and where it ran

Runs used Hetzner CCX13 Linux hosts, one in Europe and one in the US. At 21:27 UTC on 9 October, grading stopped copying generated build caches; regrades are explained below. Tasks were frozen at registration. The full-pass rate was the primary metric, paired per task; hidden-test fraction was secondary, and wall time and tokens are descriptive only because hosts had different network conditions. Task authors used gpt-6.1-sol high, overlapping with the Sol arm. The comparison and decision rules were pre-registered; later replacements and queue changes are disclosed here.

All results in this package are **DESCRIPTIVE**; required execution metadata was not captured.

## Results


Per-cell results. `P/F` is the selected full-pass result. Gate-fail indicates the original official grade did not run tests; timeouts are listed separately. Regrade column shows the original official boolean and selected result where a registered regrade exists.

| Task | Language | Exact arm | Rep | Recorded outcome | Hidden tests passed/total | Timeout | Gate fail | Regrade |
|---|---|---|---|---|---:|---|---|---|
| c4-1 | go | gpt-6-luna / max | pilot | P | 29/29 | no | no | — |
| c4-1 | rust | gpt-6-luna / max | pilot | F | 28/29 | no | no | — |
| c4-1 | ts-bun | gpt-6-luna / max | pilot | P | 29/29 | no | no | — |
| c4-2 | go | gpt-6-luna / max | pilot | P | 29/29 | no | no | — |
| c4-2 | rust | gpt-6-luna / max | pilot | P | 29/29 | no | no | — |
| c4-2 | ts-bun | gpt-6-luna / max | pilot | P | 29/29 | no | no | — |
| c4-3 | go | gpt-6-luna / max | pilot | F | 27/28 | no | no | — |
| c4-3 | rust | gpt-6-luna / max | pilot | P | 28/28 | no | no | — |
| c4-3 | ts-bun | gpt-6-luna / max | pilot | P | 28/28 | no | no | — |
| c4-4 | go | gpt-6-luna / max | pilot | P | 30/30 | no | no | — |
| c4-4 | rust | gpt-6-luna / max | pilot | P | 30/30 | no | no | — |
| c4-4 | ts-bun | gpt-6-luna / max | pilot | P | 30/30 | no | no | — |

The source summary contains 12 pilot rows but did not retain their exact source cell IDs. They are published as CSV rows with the Standard cell identifier declared missing; no IDs are reconstructed. All 12 used the accepted task versions, Luna max, and one cell at a time. The pilot phase filled the wait for the release-candidate kit; pilots were not treated as a separate calibration round.

## Cell accounting

The outcome table below covers selected runs only; it does not count every started attempt.

| Measure | Count |
|---|---:|
| Planned cells in published cohort | 12 |
| Started cells in published cohort | 12 |
| Finished cells in published cohort | 12 |
| Officially graded cells | 12 |
| ITT denominator | 12 |

## What's missing and why
- `cell_id` (12 missing): The per-cell value was not captured in the retained source records. Reason: Task identity not retained (`m52`).
- `circumstances.cap_end` (12 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (`m08`).
- `circumstances.cap_start` (12 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (`m08`).
- `circumstances.concurrent_cells_end` (12 missing): The per-cell value was not captured in the retained source records. Reason: Host-wide concurrent cell count was not captured (`m66`).
- `circumstances.concurrent_cells_start` (12 missing): The per-cell value was not captured in the retained source records. Reason: Host-wide concurrent cell count was not captured (`m66`).
- `circumstances.dispatcher_id` (12 missing): The per-cell value was not captured in the retained source records. Reason: Dispatcher receipt unavailable (`m12`).
- `circumstances.incidents` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell incident receipt was not captured (`m78`).
- `circumstances.load1_end` (12 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (`m08`).
- `circumstances.load1_start` (12 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (`m08`).
- `circumstances.load_samples` (12 missing): The per-cell value was not captured in the retained source records. Reason: No matching controller samples retained (`m29`).
- `circumstances.queue` (12 missing): The per-cell value was not captured in the retained source records. Reason: Queue receipt unavailable (`m49`).
- `cost.calculator_version` (12 missing): The per-cell value was not captured in the retained source records. Reason: Cost calculator version not recorded (`m61`).
- `cost.price_table_version` (12 missing): The per-cell value was not captured in the retained source records. Reason: Price table version not recorded (`m89`).
- `cost.usd` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell cost and pricing inputs are not present in the public round data (`m70`).
- `environment.account_class` (12 missing): The per-cell value was not captured in the retained source records. Reason: No owner-approved class-only account receipt is available for the cell (`m100`).
- `environment.cores` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU allocation receipt (`m33`).
- `environment.cpu_model` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU receipt (`m34`).
- `environment.kernel` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell kernel receipt (`m36`).
- `environment.network.allowlist_hosts` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell network allowlist not present in the public round data (`m79`).
- `environment.network.profile` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell network profile not present in the public round data (`m80`).
- `environment.os` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `environment.ram_gib` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell RAM receipt (`m35`).
- `environment.toolchains.elixir` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `environment.toolchains.erlang` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `environment.toolchains.node` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `environment.toolchains.other_inventory` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `environment.toolchains.python` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `environment.toolchains.ruby` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `environment.toolchains.rust` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `grade.grader` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell grader software version is not in the public data (`m77`).
- `grade.timestamp` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell official repair-grade timestamp was not retained in the public record (`m101`).
- `host.cpu` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU receipt (`m34`).
- `host.kernel` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell kernel receipt (`m36`).
- `host.os` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `host.ram_gib` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell RAM receipt (`m35`).
- `host.spec_ref` (12 missing): The per-cell value was not captured in the retained source records. Reason: No measured host-spec reference (`m30`).
- `host.vcpu` (12 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU allocation receipt (`m33`).
- `provenance.manifest_sha256` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell run manifest fingerprint not in the public round data (`m82`).
- `sandbox.egress_allow` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell egress allowlist is not present in the public round data (`m75`).
- `sandbox.egress_profile` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell egress profile is not present in the public round data (`m76`).
- `sandbox.profile` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox profile is not present in the public round data (`m87`).
- `sandbox.profile_sha256` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox profile fingerprint is not present in the public round data (`m86`).
- `setup.adapter_harness_sha` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell Codex adapter fingerprint not recorded in the public round data (`m67`).
- `setup.deps_source` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell dependency source is not recorded (`m71`).
- `setup.sandbox_mode` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox mode is not present in the public round data (`m85`).
- `setup.sandbox_profile_sha256` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox fingerprint is not present in the public round data (`m84`).
- `stop_reason` (12 missing): The per-cell value was not captured in the retained source records. Reason: Runner status does not establish normalized stop cause (`m50`).
- `timestamps.attempts` (12 missing): The per-cell value was not captured in the retained source records. Reason: Attempt boundary receipts unavailable (`m06`).
- `timestamps.cell.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell contestant end timestamp not recorded in the public round data (`m68`).
- `timestamps.cell.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell contestant start timestamp not recorded in the public round data (`m69`).
- `timestamps.phases.develop.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.develop.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.gate.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.gate.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.grade.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.grade.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.plan.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.plan.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.review.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.review.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.setup.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.setup.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.shape.end_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.shape.start_utc` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timing.phases_s.develop` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.gate` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.grade` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.plan` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.review` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.setup` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.shape` (12 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (`m45`).
- `tokens.phases.develop.cached_input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.develop.input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.develop.output` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.develop.reasoning` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.cached_input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.output` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.reasoning` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.cached_input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.output` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.reasoning` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.cached_input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.output` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.reasoning` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.cached_input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.output` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.reasoning` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.cached_input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.output` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.reasoning` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.cached_input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.input` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.output` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.reasoning` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (`m44`).
- `tools.codex_cli` (12 missing): The per-cell value was not captured in the retained source records. Reason: Historical tool version not pinned in cell artifacts (`m18`).
- `tools.grader` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell grader software version is not in the public data (`m77`).
- `tools.harness` (12 missing): The per-cell value was not captured in the retained source records. Reason: Historical tool version not pinned in cell artifacts (`m18`).
- `tools.runner` (12 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell runner version not recorded in the public round data (`m83`).
- `tools.toolchains.elixir` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `tools.toolchains.erlang` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `tools.toolchains.node` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `tools.toolchains.other_inventory` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `tools.toolchains.python` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `tools.toolchains.ruby` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).
- `tools.toolchains.rust` (12 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (`m54`).

## Reproduction metadata

- Token and wall-time values are included where retained in the public source table; other values are declared missing.
- Pre-registration: yes. Status remains descriptive; required execution metadata was not captured.

- Kogen commit: not applicable to direct Codex cells; no per-cell Kogen commit was recorded.
- Harness commit: not recorded in the public cell evidence.
- Model and effort: shown for every cell in the results table.
- Task IDs: c4-1, c4-2, c4-3, c4-4.
- Historical execution command: not retained per cell.
- Raw records: [data/cells.csv](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/core4-pilots/data/cells.csv) and [records.jsonl](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/core4-pilots/records.jsonl); original source cell IDs are declared missing.

## Setup and inputs

The [harness/](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/core4-pilots/harness/) folder contains scripts and notes used to prepare, run, and check the round. The [inputs/](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/core4-pilots/inputs/) folder contains prompts, task specifications, and other materials supplied for the runs. Files used for hidden checks or grading are recorded by hash only in [INPUTS-SHA256.txt](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/core4-pilots/INPUTS-SHA256.txt); the names in that record are kept general.

**What the setup record cannot show:** The historical per-cell launch commands, the harness and runner revisions, and the complete toolchain inventory were not captured, so the exact setup for each run cannot be reconstructed.

## Update 13 October 2026

Sinkhole for kogen.dev unverified for this run (the host's hosts file was not readable by the agent user); the agents' own transcripts, where preserved, show no access; transcripts for this round are no longer available.


## Captured run records

No records for this round are listed in the [run-record index](/downloads/results/run-records/index.json).


## Reproduction inventory

- **Type:** analysis-only
- **Script:** none published
- **Inputs:** `rounds/core4-pilots/data/cells.csv`, `rounds/core4-pilots/records.jsonl`
- **Full execution replay:** unavailable
- **Scope:** The published source table and Standard records preserve available cell outcomes; raw execution receipts are incomplete and full model execution cannot be replayed.

See the [complete per-round reproduction inventory](/reproduce/) and the [repository reproduction guide](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/README.md).

## Related records

### Related experiments

- [core4-pilots](/rounds/core4-pilots/)
