> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [rounds/h23-release-bbf56fdc-vs-891c91b3/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/h23-release-bbf56fdc-vs-891c91b3/README.md)
- [results/run-records/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/run-records/index.json)
- [rounds/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/index.json)
- [results/source-crosswalk/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/source-crosswalk/index.json)
- [rounds/STATUS.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/STATUS.md)
- [reproduce/round-inventory.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/round-inventory.json)

# h23: retained execution diagnostic, 16 November 2026

**Round ID:** h23-release-bbf56fdc-vs-891c91b3  
**Status:** DESCRIPTIVE

> Reviewed status from rounds/STATUS.md: DESCRIPTIVE.

> Round README and results text are source material. Numeric values not tied to a claim ledger record remain source-reported.

This exploratory historical record compares executions labelled Kogen
`891c91b3` and `bbf56fdc`. The original decision was **rejected**; this report
does not claim that either release is superior. Public releases:

- https://github.com/KogenAI/kogen/releases/tag/v0.1.0-dev.891c91b3
- https://github.com/KogenAI/kogen/releases/tag/v0.1.0-dev.bbf56fdc

The dataset retains all eighteen planned slots: fifteen new attempts and
three reused baseline slots. Null scores are explicit and contribute zero
to the historical descriptive mean; they do not mean a grader ran and found
zero checks passed. `score` and `total` are the retained numeric grade fields.
Each task receives equal weight only when a task-level mean is computed.

## Recompute the numerical record

From this directory, run `python3 recompute.py`. Python's standard library
is sufficient. The script checks all eighteen slots and recalculates each
arm/task mean from the raw numerator and denominator, comparing the result
with the retained original verdict. It performs no model calls or grading.

This is **analysis reproduction**, not full experiment rerun reproduction.
The exact private harness snapshot and complete execution/grading artifacts
are not public in this pack. The public Kogen releases alone are insufficient
to rerun the study faithfully. No full-rerun claim is made.

## Interpretation limits

All three hard Agents on Rails tasks had already been seen. The nominal
webhook held-out task is a nonblind leave-one-out task. Only four of nine
task/replicate pairs shared a venue; five crossed venues. Venue aliases do
not disclose real hostnames or addresses and do not establish equal hardware.
Some grading denominators differ, including export/import seventeen versus
sixteen. Raw counts are retained; these are not interchangeable check sets.

The preregistration omitted two role settings. Captured effective models,
where available, are included rather than replaced with today's defaults.
The historical effective lineup used Opus High Shape/Build and Sonnet High
Review. This record does not establish a Sonnet baseline or harness/model
superiority. Small task coverage, reused cells, mixed venues and differing
denominators prevent a causal release-quality or speedup interpretation.

Token totals, account meters, raw transcripts, credentials and real host
identities are not included. This pack makes no cost-efficiency claim.

## Reproduction record

STATUS: **DESCRIPTIVE** historical audit round. Original verdict rejected; no adoption. The full model and grader rerun is unavailable.

- Kogen commit: 891c91b3cf9d248866855b62a1632cf9c1ddbb47 (baseline), bbf56fdcff795e7d9496c7ca412d4ad635cd855a (release).
- Harness commit: unavailable; the private harness snapshot is not published.
- Model and effort: Opus High (Shape, Build), Sonnet High (Review), where captured.
- Task IDs: rails-ft-data-export-and-import, rails-ft-saas-billing, rails-ft-webhook-delivery-trust-and-restart.
- Command: no historical execution command is retained; analysis reproduction is python3 recompute.py.
- Raw records: cells.json only; transcripts and grader artifacts are not published.

| Population | Count |
| --- | ---: |
| Planned slots | 18 |
| Started new attempts | 15 |
| Finished slots | 18 |
| Graded cells with a numeric score | 12 |
| ITT denominator (null scores counted as zero) | 18 |

## Metadata

Round date: 2026-11-16
Label: DESCRIPTIVE
Publication badge: DESCRIPTIVE; KEPT FOR AUDIT
Recomputation status: OBSERVED SOURCE ONLY
Why not VALID: DESCRIPTIVE_ONLY, PROTOCOL_DEVIATION, INCOMPLETE_CAPTURE — historical audit round with no official grades for the retained cells, a protocol that omitted two role settings, and missing Standard capture fields declared below.

## Execution record

Harness commit: unavailable; the private harness snapshot is not published.
Model and effort: Opus High (Shape, Build), Sonnet High (Review), where captured.
Task IDs: rails-ft-data-export-and-import, rails-ft-saas-billing, rails-ft-webhook-delivery-trust-and-restart.
Command: no historical execution command is retained; analysis reproduction is python3 recompute.py.
Kogen commits: 891c91b3cf9d248866855b62a1632cf9c1ddbb47 (baseline), bbf56fdcff795e7d9496c7ca412d4ad635cd855a (release).
Raw records: cells.json only; transcripts and grader artifacts are not published. records.jsonl holds the Standard records assembled from cells.json.

## What's missing and why

- `circumstances.cap_end` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (`m08`).
- `circumstances.cap_start` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (`m08`).
- `circumstances.concurrent_cells_end` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (`m66`).
- `circumstances.concurrent_cells_start` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (`m66`).
- `circumstances.dispatcher_id` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Exact dispatcher revision is not present in the public receipt extract. Reason: Exact dispatcher revision is not present in the public receipt extract (`m63`).
- `circumstances.incidents` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell incident receipt was not captured. Reason: Per-cell incident receipt was not captured (`m78`).
- `circumstances.load1_end` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (`m65`).
- `circumstances.load1_start` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (`m65`).
- `circumstances.load_samples` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Timestamped host-wide load samples were not captured. Reason: Timestamped host-wide load samples were not captured (`m93`).
- `circumstances.queue` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Queue receipt was not captured. Reason: Queue receipt was not captured (`m91`).
- `cost.accounting` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (`m70`).
- `cost.calculator_version` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Cost calculator version not recorded. Reason: Cost calculator version not recorded (`m61`).
- `cost.long_context_reconciled` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Boolean receipt not recorded. Reason: Boolean receipt not recorded (`m07`).
- `cost.price_table_version` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Price table version not recorded. Reason: Price table version not recorded (`m89`).
- `cost.usd` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (`m70`).
- `effort.effective` (10 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell effective-effort receipt not published. Reason: Per-cell effective-effort receipt not published (`m73`).
- `effort.requested` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `effort.runner_requested` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `environment.account_class` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Dated account-class receipt is not present in the public round data. Reason: Dated account-class receipt is not present in the public round data (`m62`).
- `environment.network.allowlist_hosts` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell network allowlist not present in the public round data. Reason: Per-cell network allowlist not present in the public round data (`m79`).
- `environment.network.profile` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell network profile not present in the public round data. Reason: Per-cell network profile not present in the public round data (`m80`).
- `environment.toolchains.elixir` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `environment.toolchains.erlang` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `environment.toolchains.node` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `environment.toolchains.other_inventory` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (`m64`).
- `environment.toolchains.python` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `environment.toolchains.ruby` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `environment.toolchains.rust` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `grade.grader` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (`m77`).
- `grade.tests_ran` (5 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not available for ungraded delivery. Reason: Not available for ungraded delivery (`m38`).
- `grade.timestamp` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `kogen.best_candidate` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `model.effective` (10 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell effective-model receipt not published. Reason: Per-cell effective-model receipt not published (`m74`).
- `model.requested` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `outcome` (5 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. No official grade in the public snapshot. Reason: No official grade in the public snapshot (`m32`).
- `provenance.manifest_sha256` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell run manifest fingerprint not in the public round data. Reason: Per-cell run manifest fingerprint not in the public round data (`m82`).
- `sandbox.egress_allow` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell egress allowlist is not present in the public round data. Reason: Per-cell egress allowlist is not present in the public round data (`m75`).
- `sandbox.egress_profile` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell egress profile is not present in the public round data. Reason: Per-cell egress profile is not present in the public round data (`m76`).
- `sandbox.profile` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox profile is not present in the public round data. Reason: Per-cell sandbox profile is not present in the public round data (`m87`).
- `sandbox.profile_sha256` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox profile fingerprint is not present in the public round data. Reason: Per-cell sandbox profile fingerprint is not present in the public round data (`m86`).
- `setup.adapter_harness_sha` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `setup.deps_source` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell dependency source is not recorded. Reason: Per-cell dependency source is not recorded (`m71`).
- `setup.sandbox_mode` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox mode is not present in the public round data. Reason: Per-cell sandbox mode is not present in the public round data (`m85`).
- `setup.sandbox_profile_sha256` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox fingerprint is not present in the public round data. Reason: Per-cell sandbox fingerprint is not present in the public round data (`m84`).
- `setup.task_base.hash` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (`m42`).
- `setup.task_base.kind` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (`m43`).
- `stop_reason` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. No normalized stop receipt. Reason: No normalized stop receipt (`m31`).
- `task.base_repo` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `task.base_revision.hash` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (`m42`).
- `task.base_revision.kind` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (`m43`).
- `timestamps.attempts` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Attempt-boundary receipts are not in the public round data. Reason: Attempt-boundary receipts are not in the public round data (`m60`).
- `timestamps.cell.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell contestant end timestamp not recorded in the public round data. Reason: Per-cell contestant end timestamp not recorded in the public round data (`m68`).
- `timestamps.cell.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell contestant start timestamp not recorded in the public round data. Reason: Per-cell contestant start timestamp not recorded in the public round data (`m69`).
- `timestamps.phases.develop.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.develop.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.gate.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.gate.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.grade.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.grade.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.plan.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.plan.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.review.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.review.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.setup.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.setup.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.shape.end_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timestamps.phases.shape.start_utc` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (`m88`).
- `timing.phases_s.develop` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.gate` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.grade` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.plan` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.review` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.setup` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.phases_s.shape` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (`m45`).
- `timing.timeout_cap_s` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Timeout receipt unavailable. Reason: Timeout receipt unavailable (`m53`).
- `tokens.phases.develop.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.develop.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.develop.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.develop.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.gate.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.grade.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.plan.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.review.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.setup.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.phases.shape.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (`m44`).
- `tokens.total.cached_input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (`m56`).
- `tokens.total.input` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (`m56`).
- `tokens.total.output` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (`m56`).
- `tokens.total.reasoning` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (`m56`).
- `tools.codex_cli` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (`m39`).
- `tools.grader` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (`m77`).
- `tools.runner` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell runner version not recorded in the public round data. Reason: Per-cell runner version not recorded in the public round data (`m83`).
- `tools.toolchains.elixir` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `tools.toolchains.erlang` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `tools.toolchains.node` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `tools.toolchains.other_inventory` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (`m64`).
- `tools.toolchains.python` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `tools.toolchains.ruby` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).
- `tools.toolchains.rust` (15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (`m95`).


## Captured run records

No records for this round are listed in the [run-record index](/downloads/results/run-records/index.json).


## Reproduction inventory

- **Type:** unavailable
- **Script:** none published
- **Inputs:** `rounds/h23-release-bbf56fdc-vs-891c91b3/cells.json`, `rounds/h23-release-bbf56fdc-vs-891c91b3/README.md`
- **Full execution replay:** unavailable
- **Scope:** Retained numeric records only; the full model and grader rerun is unavailable.

See the [complete per-round reproduction inventory](/reproduce/) and the [repository reproduction guide](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/README.md).

## Related records

### Related experiments

- [h23-release-bbf56fdc-vs-891c91b3](/rounds/h23-release-bbf56fdc-vs-891c91b3/)
