Round claim-b-screen-1

Claim B transport screen

Status · INVALIDReviewed status is transcribed from rounds/STATUS.md. The original narrative and its qualifications remain below.

Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.

Round source README · rounds/claim-b-screen-1/README.md

Round date: HISTORICAL (before 2026-10-09) Publication badge: INVALID; KEPT FOR AUDIT Why not VALID: The historical inventory retains INVALID because of OUTCOME_CLASSIFICATION_INVALID, OUTCOME_CROSSWALK_MISSING. See the round evidence and limitations below. Recomputation status: OBSERVED SOURCE ONLY

Recomputation update: The mined raw records now provide per-cell outcome, manifest token-counter, and wall-time recomputation for the observed cohort. This does not reconstruct missing planned cells, a full intention-to-treat denominator, or model execution.

Status

INVALID

Why not VALID

  • OUTCOME_CLASSIFICATION_INVALID: Transport interruptions were classified as model failures.
  • OUTCOME_CROSSWALK_MISSING: Exact affected cell IDs and corrected grades are absent.

Required reproduction metadata

  • Kogen commit: not recorded in the cited round source.
  • Harness commit: not recorded in the cited round source as a Git commit; any adapter or runtime fingerprints are not Git commits.
  • Raw records: the public capture manifest is linked above; the scored source rows and a complete raw request/grade bundle are not present in this snapshot.

STATUS: CONFOUNDED

Status reason: the research summary attributes several kh failures to a transport interruption that the runner classified as a model failure. This screen cannot support an efficacy comparison.

See missing evidence for release blockers.

Hypotheses covered: H21–H22, asking whether a custom kh harness can match another harness and whether an end-to-end route changes that comparison. This screen did not establish either proposition.

Design and correction status

The research summary records a harness comparison that was confounded by a transport interruption. The runner classified some transport failures as model failures. The exact cell IDs and corrected grades are not in the public capture, so this page withholds the source-reported outcome totals and does not establish Claim B.

Public capture

The public capture manifest is header-only: no delivery ID could be assigned to this named screen from the public captures. The public run-record index and cells.jsonl therefore contain no exact-ID grade crosswalk for the reported outcomes.

Reproduction record

  • Harness and Kogen revision: a full commit SHA is not bound to the scored cells in the public record. The captured source metadata does not establish the historical harness revision.
  • Model and effort: no public exact-ID record binds the model and effort to the scored cells.
  • Task IDs: the exact scored task IDs are not enumerated in the cited public record.
  • Historical launch command: not recoverable from the public record.
  • Rebuild the sanitized public ledgers with python3 reproduce/build_records.py and python3 reproduce/export_results.py. This does not rerun or grade the historical cells.
  • Raw public records: run-record index and cells.jsonl; no exact screen IDs are present in the capture manifest.

Interpretation

The transport correction changes the meaning of the initial failure tally. Preserve the patch and autonomous columns separately, and do not treat the reported 2/6 versus 5/6 patch result as model evidence.

Recomputed from raw records

`recomputed.json`, mined cell records, and the token audit back observed official outcomes, per-arm pass counts/rates, manifest token counters, and wall medians. The source contains 15 rows (fail 7, grader_error 1, pass 7); overall pass rate is 50.0% (7/14) among pass/fail grades. Per-arm detail and coverage counts are in the JSON.

No shared cell IDs are present in the committed public grade export; the source-only cohort is checked against the page's reported figures below. No shared public-export cell IDs are available for a paired outcome comparison. No complete published metadata/manifest token pairs are available for this round (0 missing manifest usage; 15 missing published metadata). Missing counters remain unknown, not zero. This round also has 15 raw-only or non-public rows; they are kept separate from the published-export denominator.

Captured run records

Standard-schema records assigned to this round in the indexed snapshot.

No per-round file is listed. Check the run-record index for the complete partition list.

Reproduction inventory

Published analysis replay and full experiment replay are reported separately.

Replay type
unavailable
Script
No per-round analysis script is published.
Inputs
No identified public input bundle.
Full execution replay
Unavailable
Scope
No public per-round analysis script with a complete, identified input bundle is published. See the round README, MEASURED.md, and MISSING.md for recorded scope and gaps; historical execution inputs/toolchains/grading are not bundled.

View the complete per-round reproduction inventory · Repository reproduction guide