> Data revision: baf7c2f4307d3a989a8fb9363df8000fda3d9310
> Source files:
- [rounds/cache-key-backend-v4/README.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/README.md)
- [rounds/cache-key-backend-v4/RESULTS.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/RESULTS.md)
- [results/run-records/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/run-records/index.json)
- [rounds/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/index.json)
- [results/source-crosswalk/index.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/results/source-crosswalk/index.json)
- [rounds/STATUS.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/STATUS.md)
- [reproduce/round-inventory.json](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/round-inventory.json)

# H-BACKEND: STATUS VALID; primary finding NOT SUPPORTED

**Round ID:** cache-key-backend-v4  
**Status:** VALID

> Reviewed status from rounds/STATUS.md: VALID.

> Round README and results text are source material. Numeric values not tied to a claim ledger record remain source-reported.

Round date: HISTORICAL (before 2026-10-09)
Publication badge: VALID; KEPT FOR AUDIT
Recomputation status: FULLY RECOMPUTABLE


STATUS: **VALID** — protocol completed as registered; primary finding NOT SUPPORTED.

This preregistered ChatGPT Codex backend round reached its 11 transport-complete pairs in one execution. The frozen shared-key ≥80% and distinct-key ≤5% condition held in 5 of 11 complete pairs. K=5/11; exact one-sided p=0.7255859375; 99% Clopper–Pearson CI=[0.114469, 0.830688]. **VALID** describes protocol completion and counter integrity; it does not mean the directional hypothesis was supported.

The earlier cache-key-sharing (not in this repository) and cache-replay-v3 (not in this repository) are separate prior attempts. Their observations were not pooled into this round. See [DESIGN.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/DESIGN.md), [DECISION-RULE.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/DECISION-RULE.md), [RESULTS.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/RESULTS.md), [MEASURED.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/MEASURED.md), [ENVIRONMENT.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/ENVIRONMENT.md), and [sanitized.csv](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/sanitized.csv).

## What it shows

On this account, model, route, and date, provider-reported cache reuse varied across newly seeded pairs. The frozen hypothesis did not reproduce at its 10-of-11 threshold. The run sent 44 requests, spent 503,482 charged or reserved tokens, and replaced 0 transport-incomplete pairs.

## What it does not show

It does not locate physical cache entries, isolate `prompt_cache_key` from the linked session metadata, establish a future hit guarantee, measure billing savings or task quality, or explain the change from the prior attempts. The two endpoints use different OAuth grants and routing contexts.

## Lifecycle counts

Units are request pairs (one shared-key and one distinct-key probe arm per pair), not benchmark task cells.

| Lifecycle field | n | Basis |
|---|---:|---|
| Planned | 11 | Frozen target of transport-complete pairs. |
| Started | 11 | Attempted pairs (no transport-incomplete pair was replaced). |
| Finished | 11 | Transport-complete pairs. |
| Officially graded | 11 | Pairs evaluated by the frozen counter rule. |
| ITT denominator | 11 | All complete pairs enter the registered rule. |

## Required reproduction metadata

- Kogen commit: not applicable; this round sends direct provider requests and does not run Kogen.
- Harness commit: not recorded in the round files; the probe script is not bundled in this repository.
- Model and effort: gpt-6-luna as reported by every response; request settings are frozen in [DESIGN.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/DESIGN.md).
- Task IDs: not applicable; the fixed primer/probe fixture is identified by its manifest hash in [DESIGN.md](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/DESIGN.md).
- Historical execution command: not recorded in the round files.
- Raw records: raw plans, receipts and credentials are not retained in this repository; per-pair counters are in [sanitized.csv](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/rounds/cache-key-backend-v4/sanitized.csv).


## Results source

# Frozen decision and results

**STATUS VALID. Primary finding NOT SUPPORTED.** The frozen shared-key ≥80% and distinct-key ≤5% condition held in 5 of 11 complete pairs. The rule required at least 10 successes among 11 complete pairs. K=5/11; exact one-sided p=0.7255859375; 99% Clopper–Pearson CI=[0.114469, 0.830688]. The exact p is the upper tail under the frozen 0.5 pair-success benchmark; the interval describes sampled pair-success frequency, not a future cache guarantee.

| Item | Value |
|---|---:|
| Transport-complete pairs / target | 11 / 11 |
| Successful pairs | 5 |
| Attempted pairs / attempt cap | 11 / 15 |
| Replaced transport-incomplete pairs | 0 |
| Dispatched POSTs / cap | 44 / 60 |
| Charged or reserved tokens / cap | 503,482 / 700,000 |
| Shared probes ≥80% cached | 7 / 11 |
| Distinct probes ≥80% cached | 2 / 11 |
| HTTP 200 requests with valid final counters but incomplete terminal stream | 2 |

Every attempted pair was transport-complete, so no pair was replaced. The backend's two incomplete terminal streams had valid final counters and remained measured under the frozen transport rule. No stream guard fired, no request failed authentication, and the runner did not abort. A measured zero-cache probe remained in the denominator.


## Captured run records

No records for this round are listed in the [run-record index](/downloads/results/run-records/index.json).


## Reproduction inventory

- **Type:** unavailable
- **Script:** none published
- **Inputs:** none identified
- **Full execution replay:** unavailable
- **Scope:** Probe script and raw request receipts are not published; sanitized per-pair counters are in the round sanitized.csv and the registered rule is recomputable from them by hand.

See the [complete per-round reproduction inventory](/reproduce/) and the [repository reproduction guide](https://github.com/KogenAI/kogen-bench/blob/baf7c2f4307d3a989a8fb9363df8000fda3d9310/reproduce/README.md).

## Related records

### Related experiments

- [cache-key-backend-v4](/rounds/cache-key-backend-v4/)
