Round h23-release-bbf56fdc-vs-891c91b3
h23: retained execution diagnostic, 16 November 2026
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/h23-release-bbf56fdc-vs-891c91b3/README.md
This exploratory historical record compares executions labelled Kogen
891c91b3 and bbf56fdc. The original decision was rejected; this report
does not claim that either release is superior. Public releases:
- https://github.com/KogenAI/kogen/releases/tag/v0.1.0-dev.891c91b3
- https://github.com/KogenAI/kogen/releases/tag/v0.1.0-dev.bbf56fdc
The dataset retains all eighteen planned slots: fifteen new attempts and
three reused baseline slots. Null scores are explicit and contribute zero
to the historical descriptive mean; they do not mean a grader ran and found
zero checks passed. score and total are the retained numeric grade fields.
Each task receives equal weight only when a task-level mean is computed.
Recompute the numerical record
From this directory, run python3 recompute.py. Python's standard library
is sufficient. The script checks all eighteen slots and recalculates each
arm/task mean from the raw numerator and denominator, comparing the result
with the retained original verdict. It performs no model calls or grading.
This is analysis reproduction, not full experiment rerun reproduction. The exact private harness snapshot and complete execution/grading artifacts are not public in this pack. The public Kogen releases alone are insufficient to rerun the study faithfully. No full-rerun claim is made.
Interpretation limits
All three hard Agents on Rails tasks had already been seen. The nominal webhook held-out task is a nonblind leave-one-out task. Only four of nine task/replicate pairs shared a venue; five crossed venues. Venue aliases do not disclose real hostnames or addresses and do not establish equal hardware. Some grading denominators differ, including export/import seventeen versus sixteen. Raw counts are retained; these are not interchangeable check sets.
The preregistration omitted two role settings. Captured effective models, where available, are included rather than replaced with today's defaults. The historical effective lineup used Opus High Shape/Build and Sonnet High Review. This record does not establish a Sonnet baseline or harness/model superiority. Small task coverage, reused cells, mixed venues and differing denominators prevent a causal release-quality or speedup interpretation.
Token totals, account meters, raw transcripts, credentials and real host identities are not included. This pack makes no cost-efficiency claim.
Reproduction record
STATUS: DESCRIPTIVE historical audit round. Original verdict rejected; no adoption. The full model and grader rerun is unavailable.
- Kogen commit: 891c91b3cf9d248866855b62a1632cf9c1ddbb47 (baseline), bbf56fdcff795e7d9496c7ca412d4ad635cd855a (release).
- Harness commit: unavailable; the private harness snapshot is not published.
- Model and effort: Opus High (Shape, Build), Sonnet High (Review), where captured.
- Task IDs: rails-ft-data-export-and-import, rails-ft-saas-billing, rails-ft-webhook-delivery-trust-and-restart.
- Command: no historical execution command is retained; analysis reproduction is python3 recompute.py.
- Raw records: cells.json only; transcripts and grader artifacts are not published.
| Population | Count |
|---|---|
| Planned slots | 18 |
| Started new attempts | 15 |
| Finished slots | 18 |
| Graded cells with a numeric score | 12 |
| ITT denominator (null scores counted as zero) | 18 |
Metadata
Round date: 2026-11-16 Label: DESCRIPTIVE Publication badge: DESCRIPTIVE; KEPT FOR AUDIT Recomputation status: OBSERVED SOURCE ONLY Why not VALID: DESCRIPTIVE_ONLY, PROTOCOL_DEVIATION, INCOMPLETE_CAPTURE — historical audit round with no official grades for the retained cells, a protocol that omitted two role settings, and missing Standard capture fields declared below.
Execution record
Harness commit: unavailable; the private harness snapshot is not published. Model and effort: Opus High (Shape, Build), Sonnet High (Review), where captured. Task IDs: rails-ft-data-export-and-import, rails-ft-saas-billing, rails-ft-webhook-delivery-trust-and-restart. Command: no historical execution command is retained; analysis reproduction is python3 recompute.py. Kogen commits: 891c91b3cf9d248866855b62a1632cf9c1ddbb47 (baseline), bbf56fdcff795e7d9496c7ca412d4ad635cd855a (release). Raw records: cells.json only; transcripts and grader artifacts are not published. records.jsonl holds the Standard records assembled from cells.json.
What's missing and why
circumstances.cap_end(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.cap_start(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.concurrent_cells_end(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.concurrent_cells_start(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.dispatcher_id(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Exact dispatcher revision is not present in the public receipt extract. Reason: Exact dispatcher revision is not present in the public receipt extract (m63).circumstances.incidents(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell incident receipt was not captured. Reason: Per-cell incident receipt was not captured (m78).circumstances.load1_end(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load1_start(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load_samples(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Timestamped host-wide load samples were not captured. Reason: Timestamped host-wide load samples were not captured (m93).circumstances.queue(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Queue receipt was not captured. Reason: Queue receipt was not captured (m91).cost.accounting(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (m70).cost.calculator_version(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Cost calculator version not recorded. Reason: Cost calculator version not recorded (m61).cost.long_context_reconciled(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Boolean receipt not recorded. Reason: Boolean receipt not recorded (m07).cost.price_table_version(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Price table version not recorded. Reason: Price table version not recorded (m89).cost.usd(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (m70).effort.effective(10 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell effective-effort receipt not published. Reason: Per-cell effective-effort receipt not published (m73).effort.requested(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).effort.runner_requested(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).environment.account_class(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Dated account-class receipt is not present in the public round data. Reason: Dated account-class receipt is not present in the public round data (m62).environment.network.allowlist_hosts(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell network allowlist not present in the public round data. Reason: Per-cell network allowlist not present in the public round data (m79).environment.network.profile(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell network profile not present in the public round data. Reason: Per-cell network profile not present in the public round data (m80).environment.toolchains.elixir(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.erlang(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.node(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.other_inventory(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).environment.toolchains.python(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.ruby(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.rust(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).grade.grader(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).grade.tests_ran(5 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not available for ungraded delivery. Reason: Not available for ungraded delivery (m38).grade.timestamp(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).kogen.best_candidate(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).model.effective(10 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell effective-model receipt not published. Reason: Per-cell effective-model receipt not published (m74).model.requested(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).outcome(5 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. No official grade in the public snapshot. Reason: No official grade in the public snapshot (m32).provenance.manifest_sha256(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell run manifest fingerprint not in the public round data. Reason: Per-cell run manifest fingerprint not in the public round data (m82).sandbox.egress_allow(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell egress allowlist is not present in the public round data. Reason: Per-cell egress allowlist is not present in the public round data (m75).sandbox.egress_profile(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell egress profile is not present in the public round data. Reason: Per-cell egress profile is not present in the public round data (m76).sandbox.profile(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox profile is not present in the public round data. Reason: Per-cell sandbox profile is not present in the public round data (m87).sandbox.profile_sha256(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox profile fingerprint is not present in the public round data. Reason: Per-cell sandbox profile fingerprint is not present in the public round data (m86).setup.adapter_harness_sha(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).setup.deps_source(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell dependency source is not recorded. Reason: Per-cell dependency source is not recorded (m71).setup.sandbox_mode(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox mode is not present in the public round data. Reason: Per-cell sandbox mode is not present in the public round data (m85).setup.sandbox_profile_sha256(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell sandbox fingerprint is not present in the public round data. Reason: Per-cell sandbox fingerprint is not present in the public round data (m84).setup.task_base.hash(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).setup.task_base.kind(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).stop_reason(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. No normalized stop receipt. Reason: No normalized stop receipt (m31).task.base_repo(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).task.base_revision.hash(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).task.base_revision.kind(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).timestamps.attempts(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Attempt-boundary receipts are not in the public round data. Reason: Attempt-boundary receipts are not in the public round data (m60).timestamps.cell.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell contestant end timestamp not recorded in the public round data. Reason: Per-cell contestant end timestamp not recorded in the public round data (m68).timestamps.cell.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell contestant start timestamp not recorded in the public round data. Reason: Per-cell contestant start timestamp not recorded in the public round data (m69).timestamps.phases.develop.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.develop.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.end_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.start_utc(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timing.phases_s.develop(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.gate(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.grade(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.plan(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.review(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.setup(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.shape(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.timeout_cap_s(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Timeout receipt unavailable. Reason: Timeout receipt unavailable (m53).tokens.phases.develop.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.gate.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.grade.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.plan.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.review.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.setup.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.shape.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.total.cached_input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (m56).tokens.total.input(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (m56).tokens.total.output(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (m56).tokens.total.reasoning(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Usage counter unavailable. Reason: Usage counter unavailable (m56).tools.codex_cli(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).tools.grader(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).tools.runner(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Per-cell runner version not recorded in the public round data. Reason: Per-cell runner version not recorded in the public round data (m83).tools.toolchains.elixir(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.erlang(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.node(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.other_inventory(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).tools.toolchains.python(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.ruby(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.rust(15 missing): cells.json retains only each slot's outcome, score, venue alias, wall time and (for some slots) resolved role models; it carries no value for this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
No per-round file is listed. Check the run-record index for the complete partition list.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
unavailable- Script
- No per-round analysis script is published.
- Inputs
- Full execution replay
- Unavailable
- Scope
- Retained numeric records only; the full model and grader rerun is unavailable.
View the complete per-round reproduction inventory · Repository reproduction guide