Subject area
7 records across all collections
Fatima Zahra El Idrissi, Ravi Menon
Model checkpoints are cited by URL and then disappear. We propose a metadata profile for model checkpoints that supports DOIs, content hashes and links to training data and code, and evaluate it by retro-fitting 120 published checkpoints.
Fatima Zahra El Idrissi, Tomás Ibarra
Datasheets improve transparency but are time-consuming to write. We show that a template-driven workflow with automatic statistics halves the time to a complete datasheet and increases the completeness of answers on a fifteen-item rubric.
We attempt to build and run 400 research repositories released between 2019 and 2021. Only 38% still run without modification; the most common causes are unpinned dependencies and removed external data. Archived releases with lock files survive at more than twice the rate.
2,400 anonymised checklist responses with an independent assessment of whether each claim is supported by the accompanying paper. Basis of the OPENAIR 2026 audit.
Fatima Zahra El Idrissi, Ravi Menon, Ingrid Novak
A step-by-step handbook for sharing datasets, code and models so that others can find, cite and reuse them. It covers licences, documentation, identifiers, repositories, privacy, and long-term preservation, with checklists that can be adopted by labs and venues.
Priya Venkataraman, Daniel Okafor
Configurations, training curves and evaluation metrics for 1,160 fine-tuning runs across six model sizes and four adaptation methods. Model weights are not included.
A registry of 4,000 synthetic tools with descriptions, argument schemas and three task families, used to study tool selection at scale. Also includes a small registry of 600 real API descriptions.
