> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [results/claim-ledger.jsonl](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/claim-ledger.jsonl)

# CL-L6-AUDITOR-ADVISORY-REPLAY

**Source:** `results/claim-ledger.jsonl`  
**Ledger status:** VALID  
**Evidence status:** Reproducible from the published offline case and call ledgers; not a live Build-gate estimate.

Values below are transcribed from this claim-ledger entry. The site does not recalculate them. A status such as INTERIM, CONFOUNDED, or WITHDRAWN is not a validated advantage.

## Claim fields

- **metric:** `"offline_auditor_target_check"`
- **numerator:** `null`
- **denominator:** `null`
- **unit:** `"auditor requests on 40 selected source patches"`
- **analysis_rule:** `"Score valid auditor verdicts against the original source-case outcomes. Report precision and false-demotion rate by auditor model against the preregistered targets; count timeout separately from a valid verdict."`
- **evidence_status:** `"Reproducible from the published offline case and call ledgers; not a live Build-gate estimate."`
- **claim_status:** `"VALID"`
- **publication_status:** `"STATUS_ONLY"`
- **reported_values:** `{"interpretation": "advisory only for this selected offline sample", "luna_max": {"false_demotions_percent": 35.0, "max_false_demotions_percent": 5.0, "precision_target_percent": 90.0, "veto_precision_percent": 56.25}, "requests": 80, "sol_low": {"false_demotions_percent": 25.0, "max_false_demotions_percent": 5.0, "precision_target_percent": 90.0, "veto_precision_percent": 66.67}, "timeout_requests": 1, "valid_verdicts": 79}`
- **interpretation:** `"Neither auditor meets the precision and false-demotion targets. The findings support advisory-only use for this sample, not a live gate."`
- **evidence:** `[{"path": "rounds/l6-auditor-replay/data/case_list.csv", "selector": "40 source patches and original outcomes"}, {"path": "rounds/l6-auditor-replay/data/calls.csv", "selector": "80 auditor requests; one timeout"}, {"path": "rounds/l6-auditor-replay/reproduce/score_l6.py", "selector": "public scoring transformation"}]`

## Population references

Round: [l6-auditor-replay](/rounds/l6-auditor-replay/)

### Related hypotheses

- [H67](/hypotheses/h67/)

### Related experiments

- [l6-auditor-replay](/rounds/l6-auditor-replay/)
Exact cell IDs are listed in the [source ledger](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/claim-ledger.jsonl); the site does not join outcome-only rows by guessed keys.
