Round pilot73
pilot73 — recovered shaper source round
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/pilot73/README.md
Round date: HISTORICAL (before 2026-10-09) Publication badge: DESCRIPTIVE; KEPT FOR AUDIT Why not VALID: The historical inventory retains DESCRIPTIVE because of NO_PUBLIC_CELLS, PRE_REGISTRATION_MISSING. See the round evidence and limitations below. Recomputation status: OBSERVED SOURCE ONLY
Recomputation update: The mined raw records now provide per-cell outcome, manifest token-counter, and wall-time recomputation for the observed cohort. This does not reconstruct missing planned cells, a full intention-to-treat denominator, or model execution.
Status
STATUS: DESCRIPTIVE
Why not VALID
- NO_PUBLIC_CELLS: None of the recovered source cell IDs occur in the public grade export.
- DESCRIPTIVE: The recovered source is an exploratory shaper pilot, separate from the registered r73 scored phase.
- PRE_REGISTRATION_MISSING: No pre-registration for this recovered source pilot is present in the public record.
Required reproduction metadata
- Kogen commit: not recorded in the recovered source.
- Harness commit: not recorded as a Git commit in the recovered source.
- Model and effort: mined manifests report
gpt-6-luna,max; this does not establish the registered r73 configuration. - Task IDs:
elx-05-cache-single-flight,syn-13-bug-empty-filter-crash, andsyn-14-bug-sla-business-hoursappear in the recovered cell records; mapping to the registered r73 plan is not established. - Historical execution command: not recorded in the recovered source.
- Raw records: mined public-safe cell records; source transcripts, rollouts, and request logs are excluded.
Recovered source scope
The recovered probe store contains 25 raw rows across the pilot-shaper-luna and pilot-shaper-sol labels. These are observed source records, not a recovered intention-to-treat denominator or a public grade-export cohort. The descriptive source tag pilot73 is registered separately here because it is not the registered r73 scored phase, whose page records an executed scored n of zero.
Published token metadata is absent for all 25 rows. Their manifest usage counters are retained as raw source observations and are not substitutes for a missing published token total.
| Lifecycle population | Count | Basis |
|---|---|---|
| Planned | Unknown | No complete planned-cell list is recovered. |
| Started | Unknown | Starts are not separately recorded. |
| Finished | Unknown | Finished attempts are not separately recorded. |
| Graded count | 25 | Raw source records contain 25 grade entries; none appear in the public grade export. |
| ITT denominator | Unknown | No evidence-backed inclusion/exclusion partition is recovered. |
Limits
This page makes no comparative efficacy claim and does not update any published r73 result. The observed source tag cannot establish that a planned r73 cell ran or that the recovered rows belong to the registered r73 scored phase.
Recomputed from raw records
`recomputed.json`, mined cell records, and the token audit back observed official outcomes, per-arm pass counts/rates, manifest token counters, and wall medians. The source contains 25 rows (fail 1, pass 24); overall pass rate is 96.0% (24/25) among pass/fail grades. Per-arm detail and coverage counts are in the JSON.
No shared cell IDs are present in the committed public grade export; the source-only cohort is checked against the page's reported figures below. No shared public-export cell IDs are available for a paired outcome comparison. No complete published metadata/manifest token pairs are available for this round (0 missing manifest usage; 25 missing published metadata). Missing counters remain unknown, not zero. This round also has 25 raw-only or non-public rows; they are kept separate from the published-export denominator.
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
No per-round file is listed. Check the run-record index for the complete partition list.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
analysis-only- Script
- reproduce/recompute_mined.py
python3 reproduce/recompute_mined.py - Inputs
data/mined/*.jsonl.gzreproduce/inputs/cell-metadata.jsonreproduce/inputs/grades.final.jsonl
- Full execution replay
- Unavailable
- Scope
- Regenerates observed source-row summaries and token comparisons for the recovered pilot tag. It does not establish the registered r73 scored phase, a planned denominator, or historical model execution.
View the complete per-round reproduction inventory · Repository reproduction guide