> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [results/claim-ledger.jsonl](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/claim-ledger.jsonl)

# CL-WA-offline-aa-bo3-reported-observation

**Source:** `results/claim-ledger.jsonl`  
**Ledger status:** INTERIM  
**Evidence status:** source-reported, not reproducible from public data

Values below are transcribed from this claim-ledger entry. The site does not recalculate them. A status such as INTERIM, CONFOUNDED, or WITHDRAWN is not a validated advantage.

## Claim fields

- **metric:** `"offline_false_promotion_and_selector_replay"`
- **numerator:** `null`
- **denominator:** `null`
- **unit:** `null`
- **comparison:** `null`
- **analysis_rule:** `"Offline analysis units, reviewer proxies, candidate counterfactuals, requests, and live Build cells are distinct populations; do not treat these as official Build outcomes."`
- **evidence_status:** `"source-reported, not reproducible from public data"`
- **claim_status:** `"INTERIM"`
- **publication_status:** `"RECONCILIATION_QUEUE"`
- **reported_values:** `{"deterministic_selector_pass_at_3_pct": 23.5, "direct_luna_pass_at_1_pct": 33.3, "eligible_repetition_denominator": 84, "eligible_repetitions_with_unknown_visible_exit_n": 75, "false_promotion_3_of_3_vs_1_of_3_pct": 3.17, "false_promotion_gap_2_passes_pct": 7.79, "false_promotion_gap_3_passes_pct": 2.04, "false_promotion_gap_4_of_5_vs_1_of_5_pct": 0.95, "historical_tasks_n": 34, "oracle_pass_at_3_pct": 47.1, "reps_per_arm_for_20pp_effect_n": 85, "reps_per_arm_for_30pp_effect_n": 41, "selector_tasks_n": 17}`
- **interpretation:** `"No prospective live efficacy result is established by these records."`
- **denominator_variants:** `[{"evidence_status": "source-reported, not reproducible from public data", "n": 34, "population": "false-promotion simulation tasks"}, {"evidence_status": "source-reported, not reproducible from public data", "n": 17, "population": "selector comparison tasks"}, {"evidence_status": "source-reported, not reproducible from public data", "n": 84, "population": "selector repetitions"}]`
- **evidence:** `[{"path": "rounds/offline-aa-bo3/README.md", "selector": "reported result and reproduction limits"}, {"path": "rounds/README.md", "selector": "round register and status"}]`

## Population references

Round: [offline-aa-bo3](/rounds/offline-aa-bo3/)

### Related experiments

- [offline-aa-bo3](/rounds/offline-aa-bo3/)
The ledger does not provide exact cell IDs for this claim.
