CL-SOL-LANG-REPLICATION-POSTHOC-EQUAL-TASK
VALID Reproducible from the published round-local CSV; equal-task formula is post-hoc because the original combined formula was not recorded.
- Metric
posthoc_equal_task_pass_rate- Unit
unweighted mean of six task-specific pass fractions- Analysis rule
Within each stack, compute the pass fraction for each of six task identities, then take their unweighted arithmetic mean. Show the raw combined pass totals separately; do not use this post-hoc sensitivity to execute the under-specified four-pass decision threshold.- Publication status
STATUS_ONLY- Evidence status
Reproducible from the published round-local CSV; equal-task formula is post-hoc because the original combined formula was not recorded.- Interpretation
Rates are Rust 90.3%, Go 88.9%, and TS-Bun 83.3%; the raw combined totals remain Rust 18/20, Go 18/20, and TS-Bun 15/18. This selected extension and reused cohort do not establish a general language ranking.- Reported values
{"go":{"equal_task_rate_percent":88.9,"raw_cells":20,"raw_passes":18,"task_fractions":{"r70-1-go":{"cells":3,"passes":2},"r70-2-go":{"cells":3,"passes":3},"r70-4-go-fe2":{"cells":3,"passes":2},"r70-5-go":{"cells":4,"passes":4},"r70-6-go":{"cells":4,"passes":4},"r70-7-go":{"cells":3,"passes":3}}},"rust":{"equal_task_rate_percent":90.3,"raw_cells":20,"raw_passes":18,"task_fractions":{"r70-1-rust":{"cells":3,"passes":3},"r70-2-rust":{"cells":3,"passes":3},"r70-4-rust-fe2":{"cells":3,"passes":2},"r70-5-rust":{"cells":4,"passes":4},"r70-6-rust":{"cells":4,"passes":3},"r70-7-rust":{"cells":3,"passes":3}}},"ts-bun":{"equal_task_rate_percent":83.3,"raw_cells":18,"raw_passes":15,"task_fractions":{"r70-1-ts-bun":{"cells":3,"passes":3},"r70-2-ts-bun":{"cells":3,"passes":3},"r70-4-ts-bun-fe2":{"cells":3,"passes":0},"r70-5-ts-bun":{"cells":3,"passes":3},"r70-6-ts-bun":{"cells":3,"passes":3},"r70-7-ts-bun":{"cells":3,"passes":3}}}}
Round: lang-sol-replication