Reproducibility Checklist Responses, 2024–2026
2,400 anonymised checklist responses with an independent assessment of whether each claim is supported by the accompanying paper. Basis of the OPENAIR 2026 audit.
4 resultsSearch & filters ↓
2,400 anonymised checklist responses with an independent assessment of whether each claim is supported by the accompanying paper. Basis of the OPENAIR 2026 audit.
Marcus Tan, Kofi Mensah, Lena Hartwell
1,200 tool-use tasks, each with five perturbed variants, together with the evaluation harness, a datasheet and the annotation guidelines. Accompanies the article “CTM-Bench: A Benchmark for Tool-Use Reliability in Language Agents”.
Priya Venkataraman, Daniel Okafor
Configurations, training curves and evaluation metrics for 1,160 fine-tuning runs across six model sizes and four adaptation methods. Model weights are not included.
A registry of 4,000 synthetic tools with descriptions, argument schemas and three task families, used to study tool selection at scale. Also includes a small registry of 600 real API descriptions.