> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [results/claim-ledger.jsonl](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/claim-ledger.jsonl)

# CL-WA-overstrict-replay-reported-observation

**Source:** `results/claim-ledger.jsonl`  
**Ledger status:** INTERIM  
**Evidence status:** source-reported, not reproducible from public data

Values below are transcribed from this claim-ledger entry. The site does not recalculate them. A status such as INTERIM, CONFOUNDED, or WITHDRAWN is not a validated advantage.

## Claim fields

- **metric:** `"offline_overstrict_test_replay"`
- **numerator:** `null`
- **denominator:** `null`
- **unit:** `null`
- **comparison:** `null`
- **analysis_rule:** `"Offline analysis units, reviewer proxies, candidate counterfactuals, requests, and live Build cells are distinct populations; do not treat these as official Build outcomes."`
- **evidence_status:** `"source-reported, not reproducible from public data"`
- **claim_status:** `"INTERIM"`
- **publication_status:** `"RECONCILIATION_QUEUE"`
- **reported_values:** `{"cells_without_recoverable_test_source_n": 140, "consistent_n": 992, "file_diff_pairs_n": 1638, "indeterminate_n": 0, "logical_test_files_n": 226, "overstrict_n": 168, "overstrict_pct": 14.5, "provided_r71_consistent_n": 14, "provided_r71_overstrict_n": 9, "provided_r71_test_denominator": 23, "test_cases_n": 1160}`
- **interpretation:** `"No prospective live efficacy result is established by these records."`
- **denominator_variants:** `[{"evidence_status": "source-reported, not reproducible from public data", "n": 1160, "population": "replayed test cases"}, {"evidence_status": "source-reported, not reproducible from public data", "n": 23, "population": "provided R71 subset"}, {"evidence_status": "source-reported, not reproducible from public data", "n": 140, "population": "cells without source"}]`
- **evidence:** `[{"path": "rounds/overstrict-replay/README.md", "selector": "reported result and reproduction limits"}, {"path": "rounds/README.md", "selector": "round register and status"}]`

## Population references

Round: [overstrict-replay](/rounds/overstrict-replay/)

### Related experiments

- [overstrict-replay](/rounds/overstrict-replay/)
The ledger does not provide exact cell IDs for this claim.
