Reviewed by the event organisers
Permanent, citable homes for conference papers.
Open-access proceedings for conferences, workshops and symposia. Organisers deposit their accepted papers; every paper and every volume receives a DOI.
5 resultsSearch & filters ↓
We audit 2,400 checklist responses submitted over three years and compare them against the papers they accompany. Checks for compute reporting and variance were answered affirmatively in 78% of cases but supported by the paper in only 41%, suggesting that checklists work best when responses must point to a location in the text.
Fatima Zahra El Idrissi, Tomás Ibarra
Datasheets improve transparency but are time-consuming to write. We show that a template-driven workflow with automatic statistics halves the time to a complete datasheet and increases the completeness of answers on a fifteen-item rubric.
We study reports from 300 openly reviewed machine-learning papers. Open reports are longer, more specific and more often cite evidence than comparable anonymous reports from closed venues, and reviewers who sign their reports are no more lenient. We discuss limits of the comparison.
We attempt to build and run 400 research repositories released between 2019 and 2021. Only 38% still run without modification; the most common causes are unpinned dependencies and removed external data. Archived releases with lock files survive at more than twice the rate.
We argue that venues should offer an explicit track for well-designed studies that do not find the expected effect, and outline reviewing criteria that focus on design and power rather than outcome.
