Reproducibility Checklist Responses, 2024–2026
2,400 anonymised checklist responses with an independent assessment of whether each claim is supported by the accompanying paper. Basis of the OPENAIR 2026 audit.
Preserved with checksums and version history
The long-term home for everything behind the paper.
Preserve datasets, software, models, technical reports, posters and supplementary material with persistent identifiers, version history and clear licensing.
2 resultsSearch & filters ↓
2,400 anonymised checklist responses with an independent assessment of whether each claim is supported by the accompanying paper. Basis of the OPENAIR 2026 audit.
Technical report documenting how 112 agent papers report variance, compute, prompts and judging procedures, with the full coding sheet. Supports the survey “A Survey of Evaluation Practices for Language-Model Agents”.