> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [rounds/hard1-calibrate-1/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/hard1-calibrate-1/README.md)
- [results/run-records/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/run-records/index.json)
- [rounds/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/index.json)
- [results/source-crosswalk/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/source-crosswalk/index.json)
- [rounds/STATUS.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/STATUS.md)
- [reproduce/round-inventory.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/round-inventory.json)

# Hard-task harness calibration

**Round ID:** hard1-calibrate-1  
**Status:** INVALID

> Reviewed status from rounds/STATUS.md: INVALID.

> Round README and results text are source material. Numeric values not tied to a claim ledger record remain source-reported.

Round date: HISTORICAL (before 2026-10-09)
Publication badge: INVALID; KEPT FOR AUDIT
Why not VALID: The historical inventory retains INVALID because of OUTCOME_CLASSIFICATION_UNRESOLVED, OUTCOME_CROSSWALK_MISSING. See the round evidence and limitations below.
Recomputation status: OBSERVED SOURCE ONLY


**Recomputation update:** The mined raw records now provide per-cell outcome, manifest token-counter, and wall-time recomputation for the observed cohort. This does not reconstruct missing planned cells, a full intention-to-treat denominator, or model execution.
## Status

**INVALID**

### Why not VALID
- **OUTCOME_CLASSIFICATION_UNRESOLVED:** Later review found false blockers, but the affected-cell map is unavailable.
- **OUTCOME_CROSSWALK_MISSING:** Exact-ID scored rows and complete raw grades are absent.


## Required reproduction metadata

- Kogen commit: not recorded in the cited round source.
- Harness commit: not recorded in the cited round source as a Git commit; any adapter or runtime fingerprints are not Git commits.
- Raw records: the public capture manifest is linked above; the scored source rows and a complete raw request/grade bundle are not present in this snapshot.


STATUS: **CONFOUNDED**

Status reason: the source summary reports floor and ceiling tasks, and later grader review found false blockers in some Elixir floor tasks. The exact affected-cell map is unavailable.

See [missing evidence](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/hard1-calibrate-1/MISSING.md) for release blockers.

Hypotheses covered: **H19–H22**, same-model harness comparison and custom-kh parity. This calibration does not establish a general harness winner.

## Design and correction status

The research summary describes a harness calibration on hard tasks. Some tasks were later identified as floor or ceiling cases, and a grader review found false blockers among Elixir floor tasks. The exact mapping from those corrections to this calibration is unresolved. The public capture has no exact calibration IDs or grades, so this page withholds the source-reported outcome totals and makes no comparative claim. Runner completion, if recovered, would not by itself establish task success.

## Public capture

The [public capture manifest](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/hard1-calibrate-1/public-capture-manifest.csv) is header-only: no delivery ID could be assigned to this named calibration from the public captures. The public [run-record index](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/run-records/index.json) and [cells.jsonl](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/cells.jsonl) do not provide an exact-ID grade crosswalk for the reported outcomes.

## Reproduction record

- Harness and Kogen revision: the public evidence does not provide exact per-arm harness or Kogen commit SHAs for this calibration.
- Model and effort: no public exact-ID record binds the model and effort to the scored cohort.
- Task IDs: the exact scored task IDs are not enumerated in the cited public summary.
- Historical launch command: not recoverable from the public record.
- Rebuild the sanitized public ledgers with `python3 reproduce/build_records.py` and `python3 reproduce/export_results.py`. This does not rerun or grade the historical cells.
- Raw public records: [run-record index](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/run-records/index.json) and [cells.jsonl](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/cells.jsonl); no exact calibration IDs are listed in the capture manifest.

## Interpretation

Runner completion must not be read as task success. The reported false-blocker corrections and floor/ceiling tasks make a general superiority claim unsupported; preserve the original and corrected grader states separately if exact cell receipts become available.

## Recomputed from raw records

[`recomputed.json`](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/hard1-calibrate-1/recomputed.json), [mined cell records](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/data/mined/hard1-calibrate-1.jsonl.gz), and the [token audit](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/data/mined/TOKEN-AUDIT.json) back observed official outcomes, per-arm pass counts/rates, manifest token counters, and wall medians. The source contains 48 rows (fail 34, pass 14); overall pass rate is 29.2% (14/48) among pass/fail grades. Per-arm detail and coverage counts are in the JSON.

No shared cell IDs are present in the committed public grade export; the source-only cohort is checked against the page's reported figures below.
No shared public-export cell IDs are available for a paired outcome comparison.
No complete published metadata/manifest token pairs are available for this round (0 missing manifest usage; 48 missing published metadata). Missing counters remain unknown, not zero.
This round also has 48 raw-only or non-public rows; they are kept separate from the published-export denominator.


## Captured run records

No records for this round are listed in the [run-record index](/downloads/results/run-records/index.json).


## Reproduction inventory

- **Type:** unavailable
- **Script:** none published
- **Inputs:** none identified
- **Full execution replay:** unavailable
- **Scope:** No public per-round analysis script with a complete, identified input bundle is published. See the round README, MEASURED.md, and MISSING.md for recorded scope and gaps; historical execution inputs/toolchains/grading are not bundled.

See the [complete per-round reproduction inventory](/reproduce/) and the [repository reproduction guide](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/README.md).

## Related records

### Related hypotheses

- [H19](/hypotheses/h19/)
- [H22](/hypotheses/h22/)

### Related experiments

- [hard1-calibrate-1](/rounds/hard1-calibrate-1/)

### Related claims

- [CL-WA-hard1-calibrate-1-public-capture-identity](/claims/cl-wa-hard1-calibrate-1-public-capture-identity/)
