9 resultsSearch & filters ↓
2,400 anonymised checklist responses with an independent assessment of whether each claim is supported by the accompanying paper. Basis of the OPENAIR 2026 audit.
Checkpoints and model card for the 1.1B-parameter mixed-precision student model described in the SEODML 2026 paper, with an evaluation script and measured on-device latency.
Slides of the opening keynote at the 1st Workshop on Reliable Tool-Using Agents, 12 June 2026.
Marcus Tan, Kofi Mensah, Lena Hartwell
1,200 tool-use tasks, each with five perturbed variants, together with the evaluation harness, a datasheet and the annotation guidelines. Accompanies the article “CTM-Bench: A Benchmark for Tool-Use Reliability in Language Agents”.
Python library for measuring and improving calibration of generated text, including reliability diagrams, expected calibration error variants and post-hoc recalibration methods.
Technical report documenting how 112 agent papers report variance, compute, prompts and judging procedures, with the full coding sheet. Supports the survey “A Survey of Evaluation Practices for Language-Model Agents”.
Priya Venkataraman, Daniel Okafor
Configurations, training curves and evaluation metrics for 1,160 fine-tuning runs across six model sizes and four adaptation methods. Model weights are not included.
Source code for the two-stage tool selector and the evaluation harness used in “Retrieval-Augmented Tool Selection for Long-Horizon Language Agents”. Includes configuration files to reproduce every table.
