Round review-value-2-natural-off
Natural builds with review off
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/review-value-2-natural-off/README.md
Part of a five-page study of whether Kogen's review step earns its cost; start at the main page for the design, decision rules, evidence level and task-publication note. This page holds the review-off natural builds, which measure how often a first green build is wrong.
Finding. With review switched off, 78 of 79 finished builds were correct; one was wrong (1.3%, exact one-sided 95% upper bound 5.9%). That does not show review-off is safe: the bound is above the 2% the fixed rule asked for, and 5 builds were lost. Observation only (descriptive).
14 development tasks, Sonnet 5.5 at medium effort as builder, 6 repetitions each, 84 cells. Kogen's built-in approve-without-review stub was switched on by a research patch: the lane below lists a review model, but the reviewer was never called (0 review requests in all 84 cells). With review off, the first green tree is the committed tree, so grading the final tree grades the first green. All 14 tasks are still in use; only ids and content hashes are published (TASKS.md, PLAN.json). Two of them (vm-go, cron-go) were already published as inputs of review-off-hard-1-kogen, with identical hashes.
Lanes
| Lane | Base Kogen | Patch | Models | Artifact sha256 |
|---|---|---|---|---|
| r-off | `3f032206` | rv-off-lane+dump.diff 318f2da58835342301d962fc22773b41b9a045e5d7d1773ce1e3ffba4cbf5e27 +155/-2 |
build: anthropic/claude-sonnet-5-5 medium; review: anthropic/claude-sonnet-5-5 medium | e71ffff20857bf705d5457c1b588941dee2f1d56e4c7d8c7b75d01f076e51a81 |
The review model listed in the lane is unused: review is off.
Results
| Measure | Value |
|---|---|
| Cells | 84 |
| Builds that committed a tree | 79 |
Builds lost to a builder-stage stop (all on pool-go) |
5 |
| Committed tree wrong (hidden tests fail) | 1 (cron-go, repetition 2) |
| Wrong rate among 79 | 1.3% (Wilson 95%: 0.2% to 6.8%) |
| Exact one-sided 95% upper bound | 5.9% (5.5% if the 5 lost cells are counted as correct) |
| Cost per finished cell | $0.0932 |
| Wall per finished cell | 64.1 s |
The rule fixed before the runs asked for an upper bound of at most 2% over at least 84 builds, and for review to miss at least 30% of seeded defects. Neither holds (79 builds, bound 5.9%; review caught 93.5% in the seeded cells), so review-off is not a data-supported candidate. The study prices review rather than ruling on it; see the main page.
Compared with review on (the reviewed natural builds), review off cost about 38% less per build (31.9% to 46.2%, bootstrap over the 14 task means). The review-off cells ran on a different machine type from the reviewed cells, with a different Kogen build stamp and 6 repetitions against 3, so wall times are not compared.
Limits
A bound of 5.9% means this round cannot tell a wrong-build rate of 1% from one of 5%. The 5 lost cells are all one task and come from a builder-stage stop, not from review. Cost is list price from logged token counts.
How to reproduce
python3 -I rounds/review-value-2/analyze.py recomputes the table from the published records; see the main page.
Decision rule descriptive is recorded in PLAN.json, which the run wrote before any cell started.
Counts
| Measure | Count |
|---|---|
| Planned cells | 84 |
| Started cells | 84 |
| Finished cells | 84 |
| Graded cells | 84 |
| ITT count | 84 |
Metadata
Round date: 2026-10-26 Label: DESCRIPTIVE Publication badge: DESCRIPTIVE; KEPT FOR AUDIT Recomputation status: OBSERVED SOURCE ONLY Why not VALID: DESCRIPTIVE_ONLY, PROTOCOL_DEVIATION, INCOMPLETE_CAPTURE — lane harness run, no official grades, and missing Standard capture fields declared below. STATUS: DESCRIPTIVE
Execution record
Harness commit: d1ade9fed963260d3b41a661e36c3a4b7f83f912
Model and effort: build anthropic/claude-sonnet-5-5 medium; review anthropic/claude-sonnet-5-5 medium
Task IDs: artifact-go, cron-go, deps-go, inventory-go, ledger-go, logq-go, pool-go, r70-1-go, r70-4-go, r70-5-go, r70-7-go, readtime-go, sync3-go, vm-go
Command: lanes-run, lanes-grade and lanes-export on experiment review-value-2-natural-off.
Kogen commits: 3f0322062e4568ba1e7649054287508f866a0416
Raw records: records.jsonl and the bundle in bundles/review-value-2-natural-off preserve every cell's outcome and stages; a record's ledger_sha256 hashes that cell's published attempt.json and evaluation.json.
Inputs: PLAN.json holds the hashes of the tasks, hidden tests, Intents, patches and settings; --publish-private adds the files after the round closes.
What's missing and why
circumstances.cap_end(84 missing): Kogen 3f032206 and the lane harness do not log this field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.cap_start(84 missing): Kogen 3f032206 and the lane harness do not log this field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.concurrent_cells_end(84 missing): Kogen 3f032206 and the lane harness do not log this field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.concurrent_cells_start(84 missing): Kogen 3f032206 and the lane harness do not log this field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.dispatcher_id(84 missing): Kogen 3f032206 and the lane harness do not log this field. Exact dispatcher revision is not present in the public receipt extract. Reason: Exact dispatcher revision is not present in the public receipt extract (m63).circumstances.incidents(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell incident receipt was not captured. Reason: Per-cell incident receipt was not captured (m78).circumstances.load1_end(84 missing): Kogen 3f032206 and the lane harness do not log this field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load1_start(84 missing): Kogen 3f032206 and the lane harness do not log this field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load_samples(84 missing): Kogen 3f032206 and the lane harness do not log this field. Timestamped host-wide load samples were not captured. Reason: Timestamped host-wide load samples were not captured (m93).circumstances.queue(84 missing): Kogen 3f032206 and the lane harness do not log this field. Queue receipt was not captured. Reason: Queue receipt was not captured (m91).cost.long_context_reconciled(84 missing): Kogen 3f032206 and the lane harness do not log this field. Boolean receipt not recorded. Reason: Boolean receipt not recorded (m07).environment.account_class(84 missing): Kogen 3f032206 and the lane harness do not log this field. No owner-approved class-only account receipt is available for the cell. Reason: No owner-approved class-only account receipt is available for the cell (m100).environment.network.allowlist_hosts(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell network allowlist not present in the public round data. Reason: Per-cell network allowlist not present in the public round data (m79).environment.network.profile(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell network profile not present in the public round data. Reason: Per-cell network profile not present in the public round data (m80).environment.toolchains.elixir(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.erlang(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.node(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.other_inventory(84 missing): Kogen 3f032206 and the lane harness do not log this field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).environment.toolchains.python(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.ruby(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.rust(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).grade.grader(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).grade.timestamp(84 missing): Kogen 3f032206 and the lane harness do not log this field. No official grade in the public snapshot. Reason: No official grade in the public snapshot (m32).host.id(84 missing): Kogen 3f032206 and the lane harness do not log this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).sandbox.egress_allow(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell egress allowlist is not present in the public round data. Reason: Per-cell egress allowlist is not present in the public round data (m75).sandbox.egress_profile(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell egress profile is not present in the public round data. Reason: Per-cell egress profile is not present in the public round data (m76).sandbox.profile(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell sandbox profile is not present in the public round data. Reason: Per-cell sandbox profile is not present in the public round data (m87).sandbox.profile_sha256(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell sandbox profile fingerprint is not present in the public round data. Reason: Per-cell sandbox profile fingerprint is not present in the public round data (m86).setup.adapter_harness_sha(84 missing): Kogen 3f032206 and the lane harness do not log this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).setup.deps_source(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell dependency source is not recorded. Reason: Per-cell dependency source is not recorded (m71).setup.sandbox_mode(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell sandbox mode is not present in the public round data. Reason: Per-cell sandbox mode is not present in the public round data (m85).setup.sandbox_profile_sha256(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell sandbox fingerprint is not present in the public round data. Reason: Per-cell sandbox fingerprint is not present in the public round data (m84).setup.task_base.hash(84 missing): Kogen 3f032206 and the lane harness do not log this field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).setup.task_base.kind(84 missing): Kogen 3f032206 and the lane harness do not log this field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).stop_reason(5 missing): Kogen 3f032206 and the lane harness do not log this field. No normalized stop receipt. Reason: No normalized stop receipt (m31).task.base_repo(84 missing): Kogen 3f032206 and the lane harness do not log this field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).task.base_revision.hash(84 missing): Kogen 3f032206 and the lane harness do not log this field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).task.base_revision.kind(84 missing): Kogen 3f032206 and the lane harness do not log this field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).timestamps.phases.develop.end_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.develop.start_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.end_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.start_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.end_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.start_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.end_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.start_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.end_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.start_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.end_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.start_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.end_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.start_utc(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timing.phases_s.grade(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.setup(84 missing): Kogen 3f032206 and the lane harness do not log this field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).tokens.phases.develop.cached_input(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.input(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.output(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.phases.develop.reasoning(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-phase token counter not emitted. Reason: Per-phase token counter not emitted (m44).tokens.total.cached_input(84 missing): Kogen 3f032206 and the lane harness do not log this field. Complete per-model billable vector unavailable. Reason: Complete per-model billable vector unavailable (m10).tokens.total.input(84 missing): Kogen 3f032206 and the lane harness do not log this field. Complete per-model billable vector unavailable. Reason: Complete per-model billable vector unavailable (m10).tokens.total.output(84 missing): Kogen 3f032206 and the lane harness do not log this field. Complete per-model billable vector unavailable. Reason: Complete per-model billable vector unavailable (m10).tokens.total.reasoning(84 missing): Kogen 3f032206 and the lane harness do not log this field. Complete per-model billable vector unavailable. Reason: Complete per-model billable vector unavailable (m10).tools.grader(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).tools.runner(84 missing): Kogen 3f032206 and the lane harness do not log this field. Per-cell runner version not recorded in the public round data. Reason: Per-cell runner version not recorded in the public round data (m83).tools.toolchains.elixir(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.erlang(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.node(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.other_inventory(84 missing): Kogen 3f032206 and the lane harness do not log this field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).tools.toolchains.python(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.ruby(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.rust(84 missing): Kogen 3f032206 and the lane harness do not log this field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
No per-round file is listed. Check the run-record index for the complete partition list.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
analysis-only- Script
- rounds/review-value-2/analyze.py
python3 rounds/review-value-2/analyze.py - Inputs
rounds/review-value-2-natural-off/MEASURED.mdrounds/review-value-2-natural-off/MISSING-DECLARED.jsonrounds/review-value-2-natural-off/MISSING.mdrounds/review-value-2-natural-off/PLAN.jsonrounds/review-value-2-natural-off/README.mdrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/EXCLUDED.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/artifact-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/cron-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/deps-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/inventory-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/ledger-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/logq-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/pool-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-1-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-4-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-5-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/r70-7-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/readtime-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/sync3-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r1/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r1/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r2/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r2/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r3/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r3/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r4/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r4/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r5/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r5/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r6/r-off/a1/attempt.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/attempts/vm-go/r6/r-off/a1/evaluation.jsonrounds/review-value-2-natural-off/bundles/review-value-2-natural-off/manifest.jsonrounds/review-value-2-natural-off/patches/r-off/rv-off-lane+dump.diffrounds/review-value-2-natural-off/records.jsonlrounds/review-value-2/analyze.py
- Full execution replay
- Unavailable
- Scope
- Recomputes the published tables from the records and per-cell bundles of the five review-value-2 rounds, with no model call. The task folders and cell trees are not published yet (the tasks are still in use), so cells cannot be re-graded; model execution cannot be replayed from this bundle.
View the complete per-round reproduction inventory · Repository reproduction guide