Round rtg1
RTG1 core4 replications
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/rtg1/README.md
This round compared Rust, Go, and TypeScript/Bun; descriptive full passes by language (Go, Rust, TS/Bun) were go 2/2, rust 2/2, ts-bun 1/2. The results are descriptive and establish no language decision.
Round date: 2026-10-09 Publication badge: DESCRIPTIVE; KEPT FOR AUDIT Why not VALID: Required execution metadata was not captured, so these results are descriptive and support no language ranking. Registered reasons: DESCRIPTIVE_ONLY, RAW_EVIDENCE_PARTIAL. Recomputation status: OBSERVED SOURCE ONLY Label: DESCRIPTIVE STATUS: DESCRIPTIVE
How and where it ran
Runs used Hetzner CCX13 Linux hosts, one in Europe and one in the US. At 21:27 UTC on 9 October, grading stopped copying generated build caches; regrades are explained below. Tasks were frozen at registration. The full-pass rate was the primary metric, paired per task; hidden-test fraction was secondary, and wall time and tokens are descriptive only because hosts had different network conditions. Task authors used gpt-6.1-sol high, overlapping with the Sol arm. The comparison and decision rules were pre-registered; later replacements and queue changes are disclosed here.
All results in this package are DESCRIPTIVE; required execution metadata was not captured.
Results
Per-cell results. P/F is the selected full-pass result. Gate-fail indicates the original official grade did not run tests; timeouts are listed separately. Regrade column shows the original official boolean and selected result where a registered regrade exists.
| Task | Language | Exact arm | Rep | Recorded outcome | Hidden tests passed/total | Timeout | Gate fail | Regrade |
|---|---|---|---|---|---|---|---|---|
| c4-3 | go | gpt-6-luna / max | r2 | P | 28/28 | no | no | P 28/28 → P 28/28 (clean copy) |
| c4-3 | go | gpt-6-luna / max | r3 | P | 28/28 | no | no | — |
| c4-3 | rust | gpt-6-luna / max | r2 | P | 28/28 | no | no | — |
| c4-3 | rust | gpt-6-luna / max | r3 | P | 28/28 | no | no | P 28/28 → P 28/28 (clean copy) |
| c4-3 | ts-bun | gpt-6-luna / max | r2 | F | 27/28 | no | no | — |
| c4-3 | ts-bun | gpt-6-luna / max | r3 | P | 28/28 | no | no | — |
All six runs used Hetzner Linux; this task was excluded from Mac execution because it depends on Linux process behavior. Rep 2/3 therefore covered c4-3 only. Rep-2 order was operator-chosen before the draw; rep 3 followed the draw. A 3,600-second cell cap, one stall retry after ten minutes without an agent event, and a ceiling/floor stop after six task-by-host groups were registered. No run stopped at the ceiling or floor. The planned release-candidate dry run failed its execution checks and the kit was rolled back, so these results remained descriptive.
Cell accounting
The outcome table below covers selected runs only; it does not count every started attempt.
| Measure | Count |
|---|---|
| Planned cells in published cohort | 6 |
| Started cells in published cohort | 6 |
| Finished cells in published cohort | 6 |
| Officially graded cells | 6 |
| ITT denominator | 6 |
What's missing and why
circumstances.cap_end(6 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (m08).circumstances.cap_start(6 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (m08).circumstances.concurrent_cells_end(6 missing): The per-cell value was not captured in the retained source records. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.concurrent_cells_start(6 missing): The per-cell value was not captured in the retained source records. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.dispatcher_id(6 missing): The per-cell value was not captured in the retained source records. Reason: Dispatcher receipt unavailable (m12).circumstances.incidents(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell incident receipt was not captured (m78).circumstances.load1_end(6 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (m08).circumstances.load1_start(6 missing): The per-cell value was not captured in the retained source records. Reason: Boundary telemetry not retained (m08).circumstances.load_samples(6 missing): The per-cell value was not captured in the retained source records. Reason: No matching controller samples retained (m29).circumstances.queue(6 missing): The per-cell value was not captured in the retained source records. Reason: Queue receipt unavailable (m49).cost.calculator_version(6 missing): The per-cell value was not captured in the retained source records. Reason: Cost calculator version not recorded (m61).cost.price_table_version(6 missing): The per-cell value was not captured in the retained source records. Reason: Price table version not recorded (m89).cost.usd(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell cost and pricing inputs are not present in the public round data (m70).effort.effective(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell effective-effort receipt not published (m73).environment.account_class(6 missing): The per-cell value was not captured in the retained source records. Reason: No owner-approved class-only account receipt is available for the cell (m100).environment.cores(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU allocation receipt (m33).environment.cpu_model(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU receipt (m34).environment.kernel(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell kernel receipt (m36).environment.network.allowlist_hosts(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell network allowlist not present in the public round data (m79).environment.network.profile(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell network profile not present in the public round data (m80).environment.os(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).environment.ram_gib(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell RAM receipt (m35).environment.toolchains.elixir(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).environment.toolchains.erlang(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).environment.toolchains.node(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).environment.toolchains.other_inventory(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).environment.toolchains.python(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).environment.toolchains.ruby(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).environment.toolchains.rust(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).grade.grader(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell grader software version is not in the public data (m77).grade.timestamp(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell official repair-grade timestamp was not retained in the public record (m101).host.cpu(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU receipt (m34).host.kernel(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell kernel receipt (m36).host.os(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).host.ram_gib(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell RAM receipt (m35).host.spec_ref(6 missing): The per-cell value was not captured in the retained source records. Reason: No measured host-spec reference (m30).host.vcpu(6 missing): The per-cell value was not captured in the retained source records. Reason: No per-cell CPU allocation receipt (m33).model.effective(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell effective-model receipt not published (m74).sandbox.egress_allow(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell egress allowlist is not present in the public round data (m75).sandbox.egress_profile(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell egress profile is not present in the public round data (m76).sandbox.profile(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox profile is not present in the public round data (m87).sandbox.profile_sha256(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox profile fingerprint is not present in the public round data (m86).setup.adapter_harness_sha(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell Codex adapter fingerprint not recorded in the public round data (m67).setup.deps_source(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell dependency source is not recorded (m71).setup.sandbox_mode(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox mode is not present in the public round data (m85).setup.sandbox_profile_sha256(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell sandbox fingerprint is not present in the public round data (m84).stop_reason(6 missing): The per-cell value was not captured in the retained source records. Reason: Runner status does not establish normalized stop cause (m50).timestamps.attempts(6 missing): The per-cell value was not captured in the retained source records. Reason: Attempt boundary receipts unavailable (m06).timestamps.cell.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell contestant end timestamp not recorded in the public round data (m68).timestamps.cell.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell contestant start timestamp not recorded in the public round data (m69).timestamps.phases.develop.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.develop.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.end_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.start_utc(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase timestamp not present in the public per-cell data (m88).timing.phases_s.develop(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.gate(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.grade(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.plan(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.review(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.setup(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.shape(6 missing): The per-cell value was not captured in the retained source records. Reason: Phase wall not emitted or not separable (m45).timing.total_wall_s(4 missing): The per-cell value was not captured in the retained source records. Reason: Wall counter unavailable (m58).tokens.phases.develop.cached_input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.output(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.reasoning(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.cached_input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.output(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.reasoning(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.cached_input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.output(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.reasoning(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.cached_input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.output(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.reasoning(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.cached_input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.output(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.reasoning(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.cached_input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.output(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.reasoning(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.cached_input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.input(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.output(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.reasoning(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-phase token counter not emitted (m44).tokens.total.cached_input(4 missing): The per-cell value was not captured in the retained source records. Reason: Usage counter unavailable (m56).tokens.total.input(4 missing): The per-cell value was not captured in the retained source records. Reason: Usage counter unavailable (m56).tokens.total.output(4 missing): The per-cell value was not captured in the retained source records. Reason: Usage counter unavailable (m56).tokens.total.reasoning(4 missing): The per-cell value was not captured in the retained source records. Reason: Usage counter unavailable (m56).tools.codex_cli(6 missing): The per-cell value was not captured in the retained source records. Reason: Historical tool version not pinned in cell artifacts (m18).tools.grader(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell grader software version is not in the public data (m77).tools.harness(6 missing): The per-cell value was not captured in the retained source records. Reason: Historical tool version not pinned in cell artifacts (m18).tools.runner(6 missing): The per-cell value was not captured in the retained source records. Reason: Per-cell runner version not recorded in the public round data (m83).tools.toolchains.elixir(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).tools.toolchains.erlang(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).tools.toolchains.node(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).tools.toolchains.other_inventory(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).tools.toolchains.python(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).tools.toolchains.ruby(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).tools.toolchains.rust(6 missing): The per-cell value was not captured in the retained source records. Reason: Toolchain version/inventory not recorded (m54).
Reproduction metadata
Token and wall-time values are included where retained in the public source table; other values are declared missing.
Pre-registration: yes. Status remains descriptive; required execution metadata was not captured.
Kogen commit: not applicable to direct Codex cells; no per-cell Kogen commit was recorded.
Harness commit: not recorded in the public cell evidence.
Model and effort: shown for every cell in the results table.
Task IDs: c4-3.
Historical execution command: not retained per cell.
Raw records: data/cells.csv and records.jsonl where exact source IDs are available.
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
No per-round file is listed. Check the run-record index for the complete partition list.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
analysis-only- Script
- No per-round analysis script is published.
- Inputs
- Full execution replay
- Unavailable
- Scope
- The published source table and Standard records preserve available cell outcomes; raw execution receipts are incomplete and full model execution cannot be replayed.
View the complete per-round reproduction inventory · Repository reproduction guide