Slides
Keynote Slides: Reliability Is a Measurement Problem
Slides of the opening keynote at the 1st Workshop on Reliable Tool-Using Agents, 12 June 2026.
View record 520 2440 cited
Preserved with checksums and version history
CONTINUUM Research Archive
The long-term home for everything behind the paper.
Preserve datasets, software, models, technical reports, posters and supplementary material with persistent identifiers, version history and clear licensing.
- ✓ Up to 50 GB per record
- ✓ Checksums and version history
- ✓ Link records to papers and books
- Records
- 9
- Record types
- 5
- Downloads
- 6,353
4 resultsSearch & filters ↓
Dataset
CTM-Bench: Task Set, Perturbations and Evaluation Harness
Marcus Tan, Kofi Mensah, Lena Hartwell
1,200 tool-use tasks, each with five perturbed variants, together with the evaluation harness, a datasheet and the annotation guidelines. Accompanies the article “CTM-Bench: A Benchmark for Tool-Use Reliability in Language Agents”.
View record 3,860 2,2409 cited
Software
Calibration Toolkit for Generative Models
Python library for measuring and improving calibration of generated text, including reliability diagrams, expected calibration error variants and post-hoc recalibration methods.
View record 980 4332 cited
Technical report
An Audit of Evaluation Reporting in Agent Papers
Technical report documenting how 112 agent papers report variance, compute, prompts and judging procedures, with the full coding sheet. Supports the survey “A Survey of Evaluation Practices for Language-Model Agents”.
View record 1,540 7604 cited