Round review-timing-1
Reviewing only once: cheaper, and wrong code gets through
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/review-timing-1/README.md
Descriptive run in Kogen Lab. Kogen reviews the code after every passing verification, so a change that a repair makes is reviewed again. This run tried reviewing only after the first passing verification, with the usual reviewer and with a cheaper one. Reviewing after every pass was correct in 7 of 8 attempts and let no wrong code through. Reviewing once with the same reviewer was correct in 6 of 8 and submitted wrong code twice where the usual setup was right, using 59% of the input. Reviewing once with the cheaper reviewer was correct in 3 of 8 and submitted wrong code five times. These attempts are consistent with the repeated review being what checks repaired code; dropping it saved input and, here, let defects through. A single review pass did not make the cheaper reviewer usable. Two attempts per task and configuration show a pattern on these tasks, not rates.
Question and scope
With review only after the first passing verification (Kogen Lab's review.timing = "first_green"), does a low-effort GPT-6 Luna reviewer match the usual low-effort GPT-6.1 Sol reviewer that reviews after every passing verification, and at what cost? GPT-6 Luna at low effort plans and builds in every attempt. The run used Kogen Lab, which reproduces Kogen's build loop with its own engine; its equivalence to Kogen is not measured.
- Tasks:
r70-5-elixir,r70-7-elixir,r70-5-go,r70-7-go, as in the second mechanism screen. - Configurations: Sol reviewing after every passing verification (the usual setup), Sol reviewing once, and Luna reviewing once. A low-effort Luna reviewer reviewing after every pass was not rerun: in the reviewer round it never approved on these Go tasks.
- Two repetitions per task. Each task and repetition ran all three configurations back to back on one host.
- Every attempt carried the experimental stops used in the screens: at most six repairs and 100,000 output tokens.
- The hidden tests grade each attempt independently of the workflow's own checks and review.
Results
Each cell gives the outcome and, in parentheses, the repairs used. "Wrong" means the workflow submitted code that the hidden tests failed; "stopped" means the six-repair stop ended the attempt.
| Task, repetition | Sol, after every successful verification | Sol, once | Luna, once |
|---|---|---|---|
r70-5-elixir 1 |
correct (6) | wrong (5) | wrong (2) |
r70-5-elixir 2 |
stopped (6) | correct (3) | wrong (1) |
r70-7-elixir 1 |
correct (1) | correct (1) | correct (4) |
r70-7-elixir 2 |
correct (1) | correct (1) | wrong (1) |
r70-5-go 1 |
correct (1) | correct (1) | wrong (1) |
r70-5-go 2 |
correct (1) | wrong (1) | wrong (1) |
r70-7-go 1 |
correct (0) | correct (0) | correct (1) |
r70-7-go 2 |
correct (0) | correct (1) | correct (1) |
| Correct | 7 of 8 | 6 of 8 | 3 of 8 |
| Wrong code submitted | 0 | 2 | 5 |
| Input tokens | 3.35M | 1.99M | 1.57M |
The run recorded 29 attempts and used about 8.5M input and 212k output tokens. It was interrupted once and resumed; the resumed run ran only the cells still without an outcome (four interrupted, one never started, and one whose build request the provider's content filter had refused). Both events are infrastructure outcomes and are kept in the records.
Limits
- Two attempts per task and configuration; the difference between reviewing once and every pass with the same reviewer is two attempts.
- Four tasks of one family; the stops are experimental and not part of Kogen.
- Results describe Kogen Lab's reproduction of Kogen's loop; equivalence with Kogen itself is not measured.
- Lab's evaluation is not an official kogen-bench grade, so the Standard records declare the official outcome as missing (see "What's missing and why").
Required reproduction metadata
- Kogen commit: fd0cdcfb422f6edef5ec69146cdecdb3e3c1317a, as reproduced by Kogen Lab.
- Harness commit: not recorded as a public Git commit. Kogen Lab's source is not published yet; its build fingerprint is in the bundle's
manifest.json. - Model and effort: planner and builder
gpt-6-lunaatlow; reviewergpt-6.1-solatloworgpt-6-lunaatlow, as stated per configuration. - Task IDs:
r70-5-elixir,r70-7-elixir,r70-5-go,r70-7-go. - Command:
kogen-lab freeze, thenkogen-lab run(interrupted once and resumed), thenkogen-lab exportand Lab'sexport_bench_round.pyto write these records. - Raw records: `records.jsonl` and the Lab export in `bundles/`.
Metadata
Round date: 2026-10-18
Publication badge: DESCRIPTIVE; KEPT FOR AUDIT
Recomputation status: OBSERVED SOURCE ONLY
Why not VALID: DESCRIPTIVE_ONLY, PROTOCOL_DEVIATION, INCOMPLETE_CAPTURE — Lab development run, two repetitions, no official kogen-bench grade and declared missing Standard fields.
STATUS: DESCRIPTIVE
Execution record
- One experiment, frozen before its first attempt and run from a frozen Lab development build over six host slots (three work folders on one macOS workstation, two on one Ubuntu 24.04 server, one Ubuntu 24.04 laptop).
- Records: `records.jsonl` holds one Standard 1.2 record per attempt (29), including the interrupted and refused ones. `MISSING.md` and `MEASURED.md` declare what the records cannot carry.
- `bundles/` holds Lab's public export; its
EXCLUDED.jsonlists what was left out and why.
What's missing and why
circumstances.cap_end(29 missing): The Lab export does not carry this Standard field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.cap_start(29 missing): The Lab export does not carry this Standard field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.concurrent_cells_end(29 missing): The Lab export does not carry this Standard field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.concurrent_cells_start(29 missing): The Lab export does not carry this Standard field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.dispatcher_id(29 missing): The Lab export does not carry this Standard field. Exact dispatcher revision is not present in the public receipt extract. Reason: Exact dispatcher revision is not present in the public receipt extract (m63).circumstances.incidents(29 missing): The Lab export does not carry this Standard field. Per-cell incident receipt was not captured. Reason: Per-cell incident receipt was not captured (m78).circumstances.load1_end(29 missing): The Lab export does not carry this Standard field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load1_start(29 missing): The Lab export does not carry this Standard field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load_samples(29 missing): The Lab export does not carry this Standard field. Timestamped host-wide load samples were not captured. Reason: Timestamped host-wide load samples were not captured (m93).circumstances.queue(29 missing): The Lab export does not carry this Standard field. Queue receipt was not captured. Reason: Queue receipt was not captured (m91).cost.accounting(29 missing): The Lab export does not carry this Standard field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (m70).cost.calculator_version(29 missing): The Lab export does not carry this Standard field. Cost calculator version not recorded. Reason: Cost calculator version not recorded (m61).cost.long_context_reconciled(29 missing): The Lab export does not carry this Standard field. Boolean receipt not recorded. Reason: Boolean receipt not recorded (m07).cost.price_table_version(29 missing): The Lab export does not carry this Standard field. Price table version not recorded. Reason: Price table version not recorded (m89).cost.usd(29 missing): The Lab export does not carry this Standard field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (m70).environment.account_class(29 missing): The Lab export does not carry this Standard field. No owner-approved class-only account receipt is available for the cell. Reason: No owner-approved class-only account receipt is available for the cell (m100).environment.network.allowlist_hosts(29 missing): The Lab export does not carry this Standard field. Per-cell network allowlist not present in the public round data. Reason: Per-cell network allowlist not present in the public round data (m79).environment.network.profile(29 missing): The Lab export does not carry this Standard field. Per-cell network profile not present in the public round data. Reason: Per-cell network profile not present in the public round data (m80).environment.toolchains.elixir(14 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.erlang(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.other_inventory(29 missing): The Lab export does not carry this Standard field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).environment.toolchains.python(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.ruby(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.rust(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).grade.grader(29 missing): The Lab export does not carry this Standard field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).grade.timestamp(29 missing): The Lab export does not carry this Standard field. No official grade in the public snapshot. Reason: No official grade in the public snapshot (m32).host.id(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).itt.class(29 missing): The Lab export does not carry this Standard field. No evidence-backed ITT classification. Reason: No evidence-backed ITT classification (m28).itt.cohort(29 missing): The Lab export does not carry this Standard field. No evidence-backed ITT classification. Reason: No evidence-backed ITT classification (m28).model.effective(18 missing): The Lab export does not carry this Standard field. Per-cell effective-model receipt not published. Reason: Per-cell effective-model receipt not published (m74).model.requested(19 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).outcome(29 missing): The Lab export does not carry this Standard field. Not available for ungraded delivery. Reason: Not available for ungraded delivery (m38).sandbox.egress_allow(29 missing): The Lab export does not carry this Standard field. Per-cell egress allowlist is not present in the public round data. Reason: Per-cell egress allowlist is not present in the public round data (m75).sandbox.egress_profile(29 missing): The Lab export does not carry this Standard field. Per-cell egress profile is not present in the public round data. Reason: Per-cell egress profile is not present in the public round data (m76).sandbox.profile(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox profile is not present in the public round data. Reason: Per-cell sandbox profile is not present in the public round data (m87).sandbox.profile_sha256(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox profile fingerprint is not present in the public round data. Reason: Per-cell sandbox profile fingerprint is not present in the public round data (m86).setup.adapter_harness_sha(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).setup.deps_source(29 missing): The Lab export does not carry this Standard field. Per-cell dependency source is not recorded. Reason: Per-cell dependency source is not recorded (m71).setup.sandbox_mode(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox mode is not present in the public round data. Reason: Per-cell sandbox mode is not present in the public round data (m85).setup.sandbox_profile_sha256(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox fingerprint is not present in the public round data. Reason: Per-cell sandbox fingerprint is not present in the public round data (m84).setup.task_base.hash(29 missing): The Lab export does not carry this Standard field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).setup.task_base.kind(29 missing): The Lab export does not carry this Standard field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).stop_reason(4 missing): The Lab export does not carry this Standard field. No normalized stop receipt. Reason: No normalized stop receipt (m31).task.base_repo(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).task.base_revision.hash(29 missing): The Lab export does not carry this Standard field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).task.base_revision.kind(29 missing): The Lab export does not carry this Standard field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).timestamps.phases.develop.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.develop.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timing.phases_s.develop(29 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.gate(29 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.review(2 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.setup(29 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.shape(29 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.timeout_cap_s(29 missing): The Lab export does not carry this Standard field. Timeout receipt unavailable. Reason: Timeout receipt unavailable (m53).tools.grader(29 missing): The Lab export does not carry this Standard field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).tools.runner(29 missing): The Lab export does not carry this Standard field. Per-cell runner version not recorded in the public round data. Reason: Per-cell runner version not recorded in the public round data (m83).tools.toolchains.elixir(14 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.erlang(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.other_inventory(29 missing): The Lab export does not carry this Standard field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).tools.toolchains.python(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.ruby(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.rust(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
No per-round file is listed. Check the run-record index for the complete partition list.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
analysis-only- Script
- No per-round analysis script is published.
- Inputs
rounds/review-timing-1/MEASURED.mdrounds/review-timing-1/MISSING-DECLARED.jsonrounds/review-timing-1/MISSING.mdrounds/review-timing-1/PLAN.jsonrounds/review-timing-1/README.mdrounds/review-timing-1/bundles/rt1/EXCLUDED.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/sol-every/a2/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/sol-every/a2/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r0/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/sol-first/a2/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-elixir/r1/sol-first/a2/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r0/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r0/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r0/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r0/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r0/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r0/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/sol-every/a2/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/sol-every/a2/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-5-go/r1/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r0/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r0/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r0/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r0/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r0/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r0/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/luna-first/a2/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/luna-first/a2/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-elixir/r1/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r0/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r0/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r0/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r0/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r0/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r0/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/luna-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/luna-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/luna-first/a2/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/luna-first/a2/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/sol-every/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/sol-every/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/sol-first/a1/attempt.jsonrounds/review-timing-1/bundles/rt1/attempts/r70-7-go/r1/sol-first/a1/evaluation.jsonrounds/review-timing-1/bundles/rt1/frozen/experiment.tomlrounds/review-timing-1/bundles/rt1/frozen/manifest.jsonrounds/review-timing-1/bundles/rt1/frozen/resolved/luna-first.tomlrounds/review-timing-1/bundles/rt1/frozen/resolved/sol-every.tomlrounds/review-timing-1/bundles/rt1/frozen/resolved/sol-first.tomlrounds/review-timing-1/bundles/rt1/manifest.jsonrounds/review-timing-1/bundles/rt1/report.mdrounds/review-timing-1/records.jsonl
- Full execution replay
- Unavailable
- Scope
- Published Standard records and the Lab public exports (frozen configuration, per-attempt outcomes, public test states, stage times and usage) are available; raw conversations, tool output and candidate code are not included.
View the complete per-round reproduction inventory · Repository reproduction guide