Skip to main content
ProceedingsFull paperBest paper Open access

Reproducibility Checklists in Practice: A Three-Year Audit

In Proceedings of the International Conference on Open and Reproducible AI Research (OPENAIR 2026), pp. 1–12. Nairobi, Kenya, 19 Oct 2026.

DOI 10.xxxx/ctm.pr.2026.0011 · ID CTM-PR-2026-0011

Download PDF

Cite this record

Novak, I. & Medina, C. (2026). Reproducibility Checklists in Practice: A Three-Year Audit. In Proceedings of the International Conference on Open and Reproducible AI Research (OPENAIR 2026) (pp. 1–12). CONTINUUM Proceedings. doi:10.xxxx/ctm.pr.2026.0011

Sample record. Fictional demonstration content.

Abstract

We audit 2,400 checklist responses submitted over three years and compare them against the papers they accompany. Checks for compute reporting and variance were answered affirmatively in 78% of cases but supported by the paper in only 41%, suggesting that checklists work best when responses must point to a location in the text.

Keywords reproducibility · checklists · audit

Full text

CTM-PR-2026-0011.pdf

Paper · PDF · pp. 1–12

Download

Demonstration record: no file is attached.

How to cite

Novak, I. & Medina, C. (2026). Reproducibility Checklists in Practice: A Three-Year Audit. In Proceedings of the International Conference on Open and Reproducible AI Research (OPENAIR 2026) (pp. 1–12). CONTINUUM Proceedings. doi:10.xxxx/ctm.pr.2026.0011

More from OPENAIR 2026