Round r67b
r67b
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/r67b/README.md
Round date: HISTORICAL (before 2026-10-09) Publication badge: INVALID; KEPT FOR AUDIT Why not VALID: The historical inventory retains INVALID because of CROSSWALK, INCOMPLETE_CAPTURE, NO_PREREG. See the round evidence and limitations below. Recomputation status: OBSERVED SOURCE ONLY
Recomputation update: The mined raw records now provide per-cell outcome, manifest token-counter, and wall-time recomputation for the observed cohort. This does not reconstruct missing planned cells, a full intention-to-treat denominator, or model execution.
Status
INVALID
- NO_PREREG — No public predeclared decision rule was recovered.
- CROSSWALK — Official outcomes cannot be matched to the prior Kogen arm rows.
- INCOMPLETE_CAPTURE — The refreshed public record includes ungraded or unknown deliveries and does not restore the planned arm comparison.
Required reproduction metadata
- Kogen commit: `6e826320bb4874a994d2a799b3d737f9b5400851`, the round source's pinned build.
- Harness commit: not recorded in the cited round source as a Git commit; any adapter or runtime fingerprints are not Git commits.
- Model and effort: a complete per-cell mapping is not recorded in the cited round source; values present in the source summary remain as stated above.
- Task IDs (cited Round 67b launch receipt):
elx-07-cli-stats,elx-port-erase-account,elx-port-board-publish-unpublish-public-boundary,elx-02-ingest-supervision,elx-12-retry-api-deprecation, andelx-04-queue-backpressure. The public delivery task mapping remains unresolved. - Historical execution command: not recorded in the cited round source.
- Raw records: the cited sources do not provide a complete public round-specific request and grade bundle; public delivery and outcome exports are linked above where applicable.
Terminology: public round glossary.
STATUS: INVALID
Data completeness: 51.9% (55 deliveries; PASS WITH DECLARED GAPS). Measurement contract; declared gaps.
Status reason: Official cells outcomes cannot be matched to the prior Kogen arm rows; the table and result summary are removed.
Pre-registered: no
Lifecycle: Historical capture; closure is not independently reconciled from the public record.
Question: No testable research question is recoverable from the committed public record; this page is a documentary delivery inventory, not an interpretable study. Design: Round 67b: T54/T60 Kogen rerun
Venue: Public host identifiers are listed in the reconciliation table. The surviving record does not establish every planned task-to-host assignment or the execution-environment details.
Decision rule: No public predeclared decision rule was recovered; no outcome comparison is reported.
Arms: Exact arm recipes are not recoverable from the public record; the previous label table is removed pending a cell-level crosswalk.
Planned tasks in the surviving round note: elx-07-cli-stats
Task reconciliation: The surviving plan lists elx-07-cli-stats. Task IDs in the public run-record export but not in that list: elx-02-ingest-supervision, elx-04-queue-backpressure, elx-12-retry-api-deprecation, elx-port-board-publish-unpublish-public-boundary, elx-port-erase-account. Listed task IDs with no matching tagged delivery: None. One captured delivery has no task ID in the public record. The public record does not establish intended reassignment or the reason for any mismatch; no run-record row was changed or reattributed. Verdict: Outcome interpretation remains INTERIM because task and arm assignments are not fully reconciled, and no public predeclared decision rule was recovered. Exact official grade verification resolves the export gap but does not supply an analysis rule or an unambiguous intended assignment. No benchmark comparison is reported.
Refreshed official grades
The 2026-10-07 refresh adds 42 r67b official-grade rows recorded after the original public snapshot cut (2026-10-05T11:08:31Z). Before refresh, the public export had one row, an invalid control_apply control. The additions contain 25 model rows (17 PASS, 8 FAIL) and 17 invalid controls. The refreshed export has 43 exact-joined official rows: 25 model rows (17 PASS, 8 FAIL) and 18 invalid control_apply rows, including the pre-existing control. The controls have result=invalid and source outcome=fail; they are controls, not model failures. The refreshed cells export represents them as invalid.
The previous cells.* export displayed the pre-existing control as outcome=fail; the refreshed export uses its official result=invalid classification. The before/after table separates controls from model outcomes by source kind and result.
| Count | Before refresh | Added | Refreshed export |
|---|---|---|---|
| Official rows | 1 | 42 | 43 |
| Model PASS | 0 | 17 | 17 |
| Model FAIL | 0 | 8 | 8 |
Invalid control_apply rows |
1 | 17 | 18 |
The refresh changes the public row count and verifies the official results. It does not change the verdict: the public record still lacks a predeclared decision rule and fully reconciled task/arm assignments.
Public outcome reconciliation status
The prior outcome table remains removed because the task and arm assignments are not fully reconciled to the surviving round record. The refresh exact-joins all 43 captured grade-flag rows, but official outcomes do not establish intended reassignment or provide a recovered decision rule. No combined result is reported.
Refreshed export for this tag: 55 captured deliveries; 43 exact-joined official rows (25 model rows: 17 PASS, 8 FAIL; 18 invalid controls); 12 ungraded/unknown capture rows. Control rows are not model failures.
Recomputed from raw records
`recomputed.json`, mined cell records, and the token audit back observed official outcomes, per-arm pass counts/rates, manifest token counters, and wall medians. The source contains 61 rows (fail 34, pass 27); overall pass rate is 44.3% (27/61) among pass/fail grades. Per-arm detail and coverage counts are in the JSON.
Published-export outcome cross-check: 43/43 shared cell IDs match; 0/43 public-export rows have no mined source record. Exact IDs and results for unpaired rows are in recomputed.json.
No per-cell outcome mismatches were found in the shared IDs.
Token reconciliation under METHOD.md: 1/1 published metadata totals equal the manifest input + cached input + output sum; 0 differ (no mismatches). Reasoning remains a separate reported component and is not added to output.
The recompute keeps both numbers visible. 0 unexplained single-response numeric errors were identified; multi-response rows retain the published full-cell total and the manifest counter separately because per-response usage records are excluded.
This round also has 18 raw-only or non-public rows; they are kept separate from the published-export denominator.
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
unavailable- Script
- No per-round analysis script is published.
- Inputs
- No identified public input bundle.
- Full execution replay
- Unavailable
- Scope
- No public per-round analysis script with a complete, identified input bundle is published. See the round README, MEASURED.md, and MISSING.md for recorded scope and gaps; historical execution inputs/toolchains/grading are not bundled.
View the complete per-round reproduction inventory · Repository reproduction guide