Round r49
r49
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/r49/README.md
Round date: HISTORICAL (before 2026-10-09) Publication badge: INVALID; KEPT FOR AUDIT Why not VALID: The historical inventory retains INVALID; the available public record does not support upgrading that classification. Recomputation status: OBSERVED SOURCE ONLY
Recomputation update: The mined raw records now provide per-cell outcome, manifest token-counter, and wall-time recomputation for the observed cohort. This does not reconstruct missing planned cells, a full intention-to-treat denominator, or model execution.
Status
INVALID
- NO_PREREG — The README says this round was not pre-registered, and its files show no timestamped rule predating the first result.
- NO_DECISION_RULE — The README says no public predeclared decision rule was recovered.
- RAW_BUNDLE_INCOMPLETE — The README says the public sources do not provide a complete round-specific request and grade bundle.
- OUTCOME_CROSSWALK — The README says the question and decision rule are unrecoverable and the outcome/denominator mapping is absent.
Required reproduction metadata
- Kogen commit: not recorded in the cited round source.
- Harness commit: not recorded in the cited round source as a Git commit; any adapter or runtime fingerprints are not Git commits.
- Model and effort: a complete per-cell mapping is not recorded in the cited round source; values present in the source summary remain as stated above.
- Historical execution command: not recorded in the cited round source.
- Raw records: the cited sources do not provide a complete public round-specific request and grade bundle; public delivery and outcome exports are linked above where applicable.
Terminology: public round glossary.
STATUS: INVALID
Data completeness: 39.8% (132 deliveries; PASS WITH DECLARED GAPS). Measurement contract; declared gaps.
Status reason: The question and decision rule are unrecoverable, and the official cells export and captured run-record export do not share an outcome/denominator mapping; no research result is assessed here.
Pre-registered: no
Headline-number note: The verdict figures are not re-derived here; the public results export is the outcome source.
Lifecycle: Historical capture; closure status is not independently verifiable from the public record.
Question: No testable research question is recoverable from the committed public record; this page is a documentary delivery inventory, not an interpretable study. Design: Round 49: model cascade. The design note reports offline checks passed, but the harness label has no linked public recipe or version; its implementation is unavailable in this record.
Venue: Public host identifiers remain in the linked exports; planned task-to-host assignments and execution-environment details are not established.
Decision rule: No public predeclared decision rule was recovered; outcome counts below are descriptive.
Arms: Exact recipe definitions are not recoverable from the public record; exported arm labels remain in the linked results sources.
Planned tasks in the surviving round note: elx-05-cache-single-flight, elx-07-cli-stats, elx-12-retry-api-deprecation, rails-ac-throttle-search, rails-aj-enqueue-after-commit, rails-ar-archive-book-access, rails-ar-bulk-access-grants, rails-as-variant-processed-once, rails-ft-activity-feed-api, rails-ft-cancelled-account-cleanup, rails-ft-entropy-sweep, rails-hw-scoped-broadcast, rails-sec-audit-sweep, rails-sup-legacy-conversions, syn-13-bug-empty-filter-crash, syn-14-bug-sla-business-hours
Task reconciliation: The surviving plan lists elx-05-cache-single-flight, elx-07-cli-stats, elx-12-retry-api-deprecation, rails-ac-throttle-search, rails-aj-enqueue-after-commit, rails-ar-archive-book-access, rails-ar-bulk-access-grants, rails-as-variant-processed-once, rails-ft-activity-feed-api, rails-ft-cancelled-account-cleanup, rails-ft-entropy-sweep, rails-hw-scoped-broadcast, rails-sec-audit-sweep, rails-sup-legacy-conversions, syn-13-bug-empty-filter-crash, syn-14-bug-sla-business-hours. Task IDs in the public run-record export but not in that list: rails-ft-active-storage-tracking, rails-ft-board-publish-unpublish-public-boundary, rails-ft-i18n-support, rails-ft-mysql-fulltext-search-foundation, rails-ft-notification-bundle-window-overlap, rails-ft-saas-billing. Listed task IDs with no matching tagged delivery: None. The public record does not establish intended reassignment or the reason for any mismatch; no run-record row was changed or reattributed. Verdict: Outcome interpretation is withheld because the public outcome sources do not currently support a single reconciled classification. The previous headline and reconciliation table are removed; no comparison claim is made.
Public outcome reconciliation status
The prior reconciliation table is removed because its run-record classifications or denominator do not match the official outcome export. Consult cells.jsonl for official outcome states and r49.jsonl for captured deliveries; this page does not combine them without a cell-level crosswalk.
Recomputed from raw records
`recomputed.json`, mined cell records, and the token audit back observed official outcomes, per-arm pass counts/rates, manifest token counters, and wall medians. The source contains 62 rows (fail 30, pass 32); overall pass rate is 51.6% (32/62) among pass/fail grades. Per-arm detail and coverage counts are in the JSON.
Published-export outcome cross-check: 62/62 shared cell IDs match; 0/62 public-export rows have no mined source record. Exact IDs and results for unpaired rows are in recomputed.json.
No per-cell outcome mismatches were found in the shared IDs.
Token reconciliation under METHOD.md: 0/62 published metadata totals equal the manifest input + cached input + output sum; 62 differ (multi request aggregation 62). Reasoning remains a separate reported component and is not added to output.
The recompute keeps both numbers visible. 0 unexplained single-response numeric errors were identified; multi-response rows retain the published full-cell total and the manifest counter separately because per-response usage records are excluded.
Published metadata vs raw manifest token counters (cell ID, published, manifest sum, provider response count, cause):
kh-gpt__gpt-6-luna__low__default__rails-ac-throttle-search__r2-mc-review-r49-studio: published580980, manifest226283, provider responses14;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ac-throttle-search__r3-mc-contract-r49-studio: published714359, manifest622099, provider responses35;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ac-throttle-search__r3-mc-review-r49-studio: published1003380, manifest474607, provider responses29;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-aj-enqueue-after-commit__r1-mc-review-r49-studio: published968078, manifest617276, provider responses24;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-aj-enqueue-after-commit__r2-mc-review-r49-studio: published687142, manifest357451, provider responses16;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-aj-enqueue-after-commit__r3-mc-contract-r49-studio: published1339548, manifest1284373, provider responses45;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-aj-enqueue-after-commit__r3-mc-review-r49-studio: published781489, manifest484139, provider responses25;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-archive-book-access__r1-mc-contract-r49-studio: published220014, manifest78775, provider responses8;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-archive-book-access__r3-mc-contract-r49-studio: published649949, manifest577228, provider responses38;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-archive-book-access__r3-mc-review-r49-studio: published569726, manifest281516, provider responses23;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-bulk-access-grants__r1-mc-contract-r49-studio: published175808, manifest92699, provider responses8;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-bulk-access-grants__r1-mc-review-r49-studio: published799717, manifest689939, provider responses28;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-bulk-access-grants__r2-mc-review-r49-studio: published785016, manifest509736, provider responses21;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-bulk-access-grants__r3-mc-contract-r49-studio: published890034, manifest872358, provider responses46;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ar-bulk-access-grants__r3-mc-review-r49-studio: published1141020, manifest1003376, provider responses34;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-as-variant-processed-once__r1-mc-contract-r49-studio: published1043987, manifest818249, provider responses24;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-as-variant-processed-once__r3-mc-contract-r49-studio: published3121615, manifest3060964, provider responses66;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-as-variant-processed-once__r3-mc-review-r49-studio: published3805731, manifest3554753, provider responses67;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ft-activity-feed-api__r2-mc-contract-r49-studio: published3130894, manifest3037997, provider responses61;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ft-activity-feed-api__r3-mc-review-r49-studio: published2440379, manifest2107575, provider responses32;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ft-cancelled-account-cleanup__r1-mc-review-r49-studio: published2970981, manifest2280712, provider responses33;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ft-cancelled-account-cleanup__r2-mc-review-r49-studio: published3335535, manifest2804556, provider responses34;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ft-entropy-sweep__r3-mc-contract-r49-studio: published1687020, manifest1607615, provider responses45;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-ft-entropy-sweep__r3-mc-review-r49-studio: published2466112, manifest1324395, provider responses44;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-hw-scoped-broadcast__r1-mc-contract-r49-studio: published427671, manifest348105, provider responses16;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-hw-scoped-broadcast__r3-mc-contract-r49-studio: published982955, manifest902399, provider responses42;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-hw-scoped-broadcast__r3-mc-review-r49-studio: published1593727, manifest1366170, provider responses52;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-sec-audit-sweep__r3-mc-contract-r49-studio: published1027004, manifest949676, provider responses35;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-sec-audit-sweep__r3-mc-review-r49-studio: published2190793, manifest1871524, provider responses47;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-sup-legacy-conversions__r1-mc-review-r49-studio: published1106148, manifest869718, provider responses30;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-sup-legacy-conversions__r3-mc-contract-r49-studio: published1444508, manifest1368251, provider responses48;multi_request_aggregation.kh-gpt__gpt-6-luna__low__default__rails-sup-legacy-conversions__r3-mc-review-r49-studio: published1482684, manifest1235874, provider responses34;multi_request_aggregation.r49-eu-elx12-eu-elx-12-retry-api-deprecation-mc-contract-r1: published196626, manifest155305, provider responses15;multi_request_aggregation.r49-eu-elx12-eu-elx-12-retry-api-deprecation-mc-contract-r2: published239272, manifest166806, provider responses14;multi_request_aggregation.r49-eu-elx12-eu-elx-12-retry-api-deprecation-mc-contract-r3: published320542, manifest244383, provider responses19;multi_request_aggregation.r49-eu-elx12-eu-elx-12-retry-api-deprecation-mc-review-r1: published566878, manifest480332, provider responses29;multi_request_aggregation.r49-eu-elx12-eu-elx-12-retry-api-deprecation-mc-review-r2: published210272, manifest115060, provider responses12;multi_request_aggregation.r49-eu-elx12-eu-elx-12-retry-api-deprecation-mc-review-r3: published262985, manifest212914, provider responses16;multi_request_aggregation.r49-eu-syn13-eu-syn-13-bug-empty-filter-crash-mc-contract-r1: published700227, manifest481061, provider responses17;multi_request_aggregation.r49-eu-syn13-eu-syn-13-bug-empty-filter-crash-mc-contract-r2: published607833, manifest452372, provider responses19;multi_request_aggregation.r49-eu-syn13-eu-syn-13-bug-empty-filter-crash-mc-contract-r3: published704759, manifest501522, provider responses19;multi_request_aggregation.r49-eu-syn13-eu-syn-13-bug-empty-filter-crash-mc-review-r1: published667176, manifest510086, provider responses20;multi_request_aggregation.r49-eu-syn13-eu-syn-13-bug-empty-filter-crash-mc-review-r2: published1200822, manifest1085387, provider responses34;multi_request_aggregation.r49-eu-syn13-eu-syn-13-bug-empty-filter-crash-mc-review-r3: published1004698, manifest632381, provider responses23;multi_request_aggregation.r49-eu-syn14-eu-syn-14-bug-sla-business-hours-mc-contract-r1: published259609, manifest134870, provider responses10;multi_request_aggregation.r49-eu-syn14-eu-syn-14-bug-sla-business-hours-mc-contract-r2: published181647, manifest139079, provider responses10;multi_request_aggregation.r49-eu-syn14-eu-syn-14-bug-sla-business-hours-mc-contract-r3: published327913, manifest211936, provider responses10;multi_request_aggregation.r49-eu-syn14-eu-syn-14-bug-sla-business-hours-mc-review-r1: published280541, manifest170582, provider responses13;multi_request_aggregation.r49-eu-syn14-eu-syn-14-bug-sla-business-hours-mc-review-r2: published391193, manifest221974, provider responses12;multi_request_aggregation.r49-eu-syn14-eu-syn-14-bug-sla-business-hours-mc-review-r3: published199466, manifest141664, provider responses11;multi_request_aggregation.r49-us-elx05-us-elx-05-cache-single-flight-mc-contract-r1: published112768, manifest68304, provider responses9;multi_request_aggregation.r49-us-elx05-us-elx-05-cache-single-flight-mc-contract-r2: published132524, manifest95426, provider responses10;multi_request_aggregation.r49-us-elx05-us-elx-05-cache-single-flight-mc-contract-r3: published255052, manifest231361, provider responses15;multi_request_aggregation.r49-us-elx05-us-elx-05-cache-single-flight-mc-review-r1: published245154, manifest120050, provider responses13;multi_request_aggregation.r49-us-elx05-us-elx-05-cache-single-flight-mc-review-r2: published184206, manifest103298, provider responses11;multi_request_aggregation.r49-us-elx05-us-elx-05-cache-single-flight-mc-review-r3: published282415, manifest128668, provider responses15;multi_request_aggregation.r49-us-elx07-us-elx-07-cli-stats-mc-contract-r1: published309613, manifest226302, provider responses13;multi_request_aggregation.r49-us-elx07-us-elx-07-cli-stats-mc-contract-r2: published348383, manifest308242, provider responses19;multi_request_aggregation.r49-us-elx07-us-elx-07-cli-stats-mc-contract-r3: published241014, manifest202556, provider responses13;multi_request_aggregation.r49-us-elx07-us-elx-07-cli-stats-mc-review-r1: published440326, manifest344550, provider responses20;multi_request_aggregation.r49-us-elx07-us-elx-07-cli-stats-mc-review-r2: published397033, manifest257649, provider responses16;multi_request_aggregation.r49-us-elx07-us-elx-07-cli-stats-mc-review-r3: published378416, manifest214768, provider responses14;multi_request_aggregation.
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
unavailable- Script
- No per-round analysis script is published.
- Inputs
- No identified public input bundle.
- Full execution replay
- Unavailable
- Scope
- No public per-round analysis script with a complete, identified input bundle is published. See the round README, MEASURED.md, and MISSING.md for recorded scope and gaps; historical execution inputs/toolchains/grading are not bundled.
View the complete per-round reproduction inventory · Repository reproduction guide