Round mechanism-split-1
Which flow mechanism helps a weak builder? Follow-up correct submissions were 6/7 versus 1/8
Source-reported narrativeRound README and results text are source material. Numeric values that are not tied to a claim ledger record remain source-reported.
Round source README · rounds/mechanism-split-1/README.md
Exploratory Kogen Lab screen, reported descriptively. The round is approximate: Lab verified the code in the builder's workspace, not in a clean copy of the candidate as Kogen now does.
Question and scope
Does the review-and-fix flow help a weak builder more than sending reviewer findings back through a repair loop, or more than running every verification check after a failure? Each attempt used the same weak-builder setting. The first screen used six development tasks and one attempt per task and setting. The two follow-up screens used four tasks from an earlier comparison; the two differing settings were repeated, while the run-all-checks setting was run once.
Each comparison changes one mechanism relative to the new flow: old-review replaces reviewer edits with findings sent back to the builder; run-all changes verification from stopping at the first failed check to running every check. The builder setting stays the same.
Results
Fractions show correct submissions divided by scored attempts.
| Setting | Initial correct submissions / n | Follow-up 1 correct submissions / n | Follow-up 2 correct submissions / n | Combined follow-up correct submissions / n |
|---|---|---|---|---|
| New review-and-fix flow | 2/2 | 4/4 | 2/3 | 6/7 |
| Review loop reverted | 3/3 | 0/4 | 1/4 | 1/8 |
| Run all checks | 2/3 | 3/4 | Not run | 3/4 |
The initial six-task screen was inconclusive at its declared 12M input-token budget: 8 of 18 planned attempts were scored. The review-loop-reverted setting produced correct submissions in 3 of its 3 scored attempts, so this screen did not reproduce the earlier failures.
| Follow-up setting | Correct submissions | Scored attempts | Six-repair-cap stops | Stopped code passing all hidden tests |
|---|---|---|---|---|
| New review-and-fix flow | 6 | 7 | 0 | 0 |
| Review loop reverted | 1 | 8 | 7 | 3 |
| Run all checks | 3 | 4 | 1 | 0 |
Across the two follow-ups, the new flow produced correct submissions in 6 of 7 scored attempts; the reverted review loop produced correct submissions in 1 of 8. Of the 7 repair-cap stops in that loop, 3 held code that passed every hidden test. The run-all-checks setting produced correct submissions in 3 of 4 attempts in the first follow-up. These small counts are a screen, not a general estimate.
In the second follow-up, the builder reported that it could not continue on r70-4-elixir-2; its stopped code passed 15 of 18 hidden tests. One other attempt in that follow-up ended as an infrastructure failure and was not re-run.
Limits
The initial run used different tasks from the follow-ups and stopped at its predeclared token budget. The follow-ups reused the four tasks where the earlier whole flow had failed. The run-all-checks setting had one repetition; the other two settings had two. The design is descriptive and does not qualify a production workflow.
Required reproduction metadata
- The three public bundles include their frozen configurations and per-attempt outcomes. The first screen used six development tasks; follow-ups used four tasks from the earlier flow comparison.
- The builder was set to a lower-effort model while other roles followed the default Kogen settings. The public records identify the builder model; resolved settings identify each role.
- No official kogen-bench grade was assigned. Correct-submission counts require a submission that passes all hidden tests. Hidden-test results for code left at a stop are reported separately.
- `records.jsonl` contains one Standard 1.2 record per started attempt. `MEASURED.md` and `MISSING.md` describe recorded measures and gaps. `bundles/` contains the public exports; candidate code is not included.
Metadata
Round date: 2026-10-20 Publication badge: DESCRIPTIVE; KEPT FOR AUDIT Recomputation status: OBSERVED SOURCE ONLY Why not VALID: DESCRIPTIVE_ONLY, PROTOCOL_DEVIATION, INCOMPLETE_CAPTURE — the initial screen stopped at its declared 12M input budget, one attempt was interrupted, one follow-up attempt ended as an infrastructure failure without a re-run, and there are no official kogen-bench grades; Standard capture fields are declared missing. STATUS: DESCRIPTIVE
Execution record
Kogen commit: b45ba32bacf26e2b17cb0bb81015ba56d27a4b0b.
Harness commit: not recorded as a public Git commit; the execution build is identified above.
Model and effort: Builder gpt-6-luna at low effort; reviewer gpt-6.1-sol at high effort.
Task IDs:
r70-5-go,r70-7-go,r70-5-elixir,r70-7-elixir,env-ex,sched-go,r70-1-go,r70-4-elixir-2,r70-4-go,r70-6-elixir-2.Command: The experiment was run and exported in Kogen Lab before publication.
Raw records: `records.jsonl` and the public bundles in `bundles/`.
The initial screen and both follow-ups ran on one Linux laptop with Kogen commit
b45ba32b; the Lab build and export build were3bf295ef.The initial screen ran 09:29–11:16Z on 20 October and stopped at its declared 12M input-token budget. Follow-up 1 ran 11:47–13:44Z. Follow-up 2 ran 13:49–15:22Z.
| Run | Planned attempts | Started attempts | Scored attempts | Input tokens | Notes |
|---|---|---|---|---|---|
| Initial screen | 18 | 9 | 8 | 12.02M | Stopped at the predeclared budget |
| Follow-up 1 | 12 | 12 | 12 | 5.69M | Run-all-checks setting included |
| Follow-up 2 | 8 | 8 | 7 | 3.68M | One infrastructure attempt not re-run |
| Total | 38 | 29 | 27 | 21.39M | 1 incomplete attempt; 1 infrastructure attempt |
- Follow-up 1 plus follow-up 2 used 9.37M input tokens of the 10M follow-up budget.
- In the initial screen, one new-flow attempt was interrupted and one run-all-checks attempt ended at its wall-time cap. Nine planned attempts did not start.
- `records.jsonl` keeps one Standard 1.2 record per started attempt (29). `MISSING.md` and `MEASURED.md` state what those records carry. The three public bundles'
EXCLUDED.jsonfiles list excluded material.
The list below names what the records cannot carry; reason codes are explained in `MISSING-DECLARED.json`.
What's missing and why
circumstances.cap_end(29 missing): The Lab export does not carry this Standard field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.cap_start(29 missing): The Lab export does not carry this Standard field. Boundary telemetry not retained. Reason: Boundary telemetry not retained (m08).circumstances.concurrent_cells_end(29 missing): The Lab export does not carry this Standard field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.concurrent_cells_start(29 missing): The Lab export does not carry this Standard field. Host-wide concurrent cell count was not captured. Reason: Host-wide concurrent cell count was not captured (m66).circumstances.dispatcher_id(29 missing): The Lab export does not carry this Standard field. Exact dispatcher revision is not present in the public receipt extract. Reason: Exact dispatcher revision is not present in the public receipt extract (m63).circumstances.incidents(29 missing): The Lab export does not carry this Standard field. Per-cell incident receipt was not captured. Reason: Per-cell incident receipt was not captured (m78).circumstances.load1_end(29 missing): The Lab export does not carry this Standard field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load1_start(29 missing): The Lab export does not carry this Standard field. Host boundary load was not captured in the public round data. Reason: Host boundary load was not captured in the public round data (m65).circumstances.load_samples(29 missing): The Lab export does not carry this Standard field. Timestamped host-wide load samples were not captured. Reason: Timestamped host-wide load samples were not captured (m93).circumstances.queue(29 missing): The Lab export does not carry this Standard field. Queue receipt was not captured. Reason: Queue receipt was not captured (m91).cost.accounting(29 missing): The Lab export does not carry this Standard field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (m70).cost.calculator_version(29 missing): The Lab export does not carry this Standard field. Cost calculator version not recorded. Reason: Cost calculator version not recorded (m61).cost.long_context_reconciled(29 missing): The Lab export does not carry this Standard field. Boolean receipt not recorded. Reason: Boolean receipt not recorded (m07).cost.price_table_version(29 missing): The Lab export does not carry this Standard field. Price table version not recorded. Reason: Price table version not recorded (m89).cost.usd(29 missing): The Lab export does not carry this Standard field. Per-cell cost and pricing inputs are not present in the public round data. Reason: Per-cell cost and pricing inputs are not present in the public round data (m70).effort.effective(29 missing): The Lab export does not carry this Standard field. Per-cell effective-effort receipt not published. Reason: Per-cell effective-effort receipt not published (m73).effort.requested(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).effort.runner_requested(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).environment.account_class(29 missing): The Lab export does not carry this Standard field. No owner-approved class-only account receipt is available for the cell. Reason: No owner-approved class-only account receipt is available for the cell (m100).environment.network.allowlist_hosts(29 missing): The Lab export does not carry this Standard field. Per-cell network allowlist not present in the public round data. Reason: Per-cell network allowlist not present in the public round data (m79).environment.network.profile(29 missing): The Lab export does not carry this Standard field. Per-cell network profile not present in the public round data. Reason: Per-cell network profile not present in the public round data (m80).environment.toolchains.erlang(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.other_inventory(29 missing): The Lab export does not carry this Standard field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).environment.toolchains.ruby(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).environment.toolchains.rust(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).grade.grader(29 missing): The Lab export does not carry this Standard field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).grade.timestamp(29 missing): The Lab export does not carry this Standard field. No official grade in the public snapshot. Reason: No official grade in the public snapshot (m32).host.id(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).itt.class(29 missing): The Lab export does not carry this Standard field. No evidence-backed ITT classification. Reason: No evidence-backed ITT classification (m28).itt.cohort(29 missing): The Lab export does not carry this Standard field. No evidence-backed ITT classification. Reason: No evidence-backed ITT classification (m28).outcome(29 missing): The Lab export does not carry this Standard field. Not available for ungraded delivery. Reason: Not available for ungraded delivery (m38).provenance.ledger_sha256(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).sandbox.egress_allow(29 missing): The Lab export does not carry this Standard field. Per-cell egress allowlist is not present in the public round data. Reason: Per-cell egress allowlist is not present in the public round data (m75).sandbox.egress_profile(29 missing): The Lab export does not carry this Standard field. Per-cell egress profile is not present in the public round data. Reason: Per-cell egress profile is not present in the public round data (m76).sandbox.profile(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox profile is not present in the public round data. Reason: Per-cell sandbox profile is not present in the public round data (m87).sandbox.profile_sha256(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox profile fingerprint is not present in the public round data. Reason: Per-cell sandbox profile fingerprint is not present in the public round data (m86).setup.adapter_harness_sha(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).setup.deps_source(29 missing): The Lab export does not carry this Standard field. Per-cell dependency source is not recorded. Reason: Per-cell dependency source is not recorded (m71).setup.sandbox_mode(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox mode is not present in the public round data. Reason: Per-cell sandbox mode is not present in the public round data (m85).setup.sandbox_profile_sha256(29 missing): The Lab export does not carry this Standard field. Per-cell sandbox fingerprint is not present in the public round data. Reason: Per-cell sandbox fingerprint is not present in the public round data (m84).setup.task_base.hash(29 missing): The Lab export does not carry this Standard field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).setup.task_base.kind(29 missing): The Lab export does not carry this Standard field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).stop_reason(1 missing): The Lab export does not carry this Standard field. No normalized stop receipt. Reason: No normalized stop receipt (m31).task.base_repo(29 missing): The Lab export does not carry this Standard field. Not recorded in available public metadata. Reason: Not recorded in available public metadata (m39).task.base_revision.hash(29 missing): The Lab export does not carry this Standard field. Original base commit/tree hash absent; fresh_base_commit is not a base hash. Reason: Original base commit/tree hash absent; fresh_base_commit is not a base hash (m42).task.base_revision.kind(29 missing): The Lab export does not carry this Standard field. Original base revision type not recorded per cell. Reason: Original base revision type not recorded per cell (m43).timestamps.phases.develop.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.develop.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.gate.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.grade.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.plan.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.review.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.setup.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.end_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timestamps.phases.shape.start_utc(29 missing): The Lab export does not carry this Standard field. Phase timestamp not present in the public per-cell data. Reason: Phase timestamp not present in the public per-cell data (m88).timing.phases_s.develop(29 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.gate(29 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.phases_s.setup(29 missing): The Lab export does not carry this Standard field. Phase wall not emitted or not separable. Reason: Phase wall not emitted or not separable (m45).timing.timeout_cap_s(29 missing): The Lab export does not carry this Standard field. Timeout receipt unavailable. Reason: Timeout receipt unavailable (m53).tools.grader(29 missing): The Lab export does not carry this Standard field. Per-cell grader software version is not in the public data. Reason: Per-cell grader software version is not in the public data (m77).tools.runner(29 missing): The Lab export does not carry this Standard field. Per-cell runner version not recorded in the public round data. Reason: Per-cell runner version not recorded in the public round data (m83).tools.toolchains.erlang(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.other_inventory(29 missing): The Lab export does not carry this Standard field. Full per-cell toolchain inventory not recorded. Reason: Full per-cell toolchain inventory not recorded (m64).tools.toolchains.ruby(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).tools.toolchains.rust(29 missing): The Lab export does not carry this Standard field. Toolchain version not recorded. Reason: Toolchain version not recorded (m95).
Captured run records
Standard-schema records assigned to this round in the indexed snapshot.
No per-round file is listed. Check the run-record index for the complete partition list.
Reproduction inventory
Published analysis replay and full experiment replay are reported separately.
- Replay type
analysis-only- Script
- No per-round analysis script is published.
- Inputs
rounds/mechanism-split-1/MEASURED.mdrounds/mechanism-split-1/MISSING-DECLARED.jsonrounds/mechanism-split-1/MISSING.mdrounds/mechanism-split-1/PLAN.jsonrounds/mechanism-split-1/README.mdrounds/mechanism-split-1/bundles/ms1/EXCLUDED.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-elixir/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-elixir/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-elixir/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-elixir/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-elixir/r0/run-all/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-elixir/r0/run-all/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-go/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-go/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-go/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-go/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-go/r0/run-all/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-5-go/r0/run-all/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-7-go/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-7-go/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-7-go/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-7-go/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-7-go/r0/run-all/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms1/attempts/r70-7-go/r0/run-all/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms1/frozen/experiment.tomlrounds/mechanism-split-1/bundles/ms1/frozen/manifest.jsonrounds/mechanism-split-1/bundles/ms1/frozen/resolved/new.tomlrounds/mechanism-split-1/bundles/ms1/frozen/resolved/old-review.tomlrounds/mechanism-split-1/bundles/ms1/frozen/resolved/run-all.tomlrounds/mechanism-split-1/bundles/ms1/manifest.jsonrounds/mechanism-split-1/bundles/ms1/report.mdrounds/mechanism-split-1/bundles/ms2/EXCLUDED.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-1-go/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-1-go/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-1-go/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-1-go/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-1-go/r0/run-all/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-1-go/r0/run-all/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-elixir-2/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-elixir-2/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-elixir-2/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-elixir-2/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-elixir-2/r0/run-all/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-elixir-2/r0/run-all/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-go/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-go/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-go/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-go/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-go/r0/run-all/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-4-go/r0/run-all/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-6-elixir-2/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-6-elixir-2/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-6-elixir-2/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-6-elixir-2/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-6-elixir-2/r0/run-all/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2/attempts/r70-6-elixir-2/r0/run-all/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2/frozen/experiment.tomlrounds/mechanism-split-1/bundles/ms2/frozen/manifest.jsonrounds/mechanism-split-1/bundles/ms2/frozen/resolved/new.tomlrounds/mechanism-split-1/bundles/ms2/frozen/resolved/old-review.tomlrounds/mechanism-split-1/bundles/ms2/frozen/resolved/run-all.tomlrounds/mechanism-split-1/bundles/ms2/manifest.jsonrounds/mechanism-split-1/bundles/ms2/report.mdrounds/mechanism-split-1/bundles/ms2b/EXCLUDED.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-1-go/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-1-go/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-1-go/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-1-go/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-elixir-2/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-elixir-2/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-elixir-2/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-elixir-2/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-go/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-go/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-go/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-4-go/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-6-elixir-2/r0/new/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-6-elixir-2/r0/new/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-6-elixir-2/r0/old-review/a1/attempt.jsonrounds/mechanism-split-1/bundles/ms2b/attempts/r70-6-elixir-2/r0/old-review/a1/evaluation.jsonrounds/mechanism-split-1/bundles/ms2b/frozen/experiment.tomlrounds/mechanism-split-1/bundles/ms2b/frozen/manifest.jsonrounds/mechanism-split-1/bundles/ms2b/frozen/resolved/new.tomlrounds/mechanism-split-1/bundles/ms2b/frozen/resolved/old-review.tomlrounds/mechanism-split-1/bundles/ms2b/manifest.jsonrounds/mechanism-split-1/bundles/ms2b/report.mdrounds/mechanism-split-1/records.jsonl
- Full execution replay
- Unavailable
- Scope
- Published Standard records and the Lab public exports (frozen configuration, per-attempt outcomes, public test states, stage times and usage) are available; raw conversations, tool output and candidate code are not included.
View the complete per-round reproduction inventory · Repository reproduction guide