Slides
Keynote Slides: Reliability Is a Measurement Problem
Slides of the opening keynote at the 1st Workshop on Reliable Tool-Using Agents, 12 June 2026.
View record 520 2440 cited
Preserved with checksums and version history
CONTINUUM Research Archive
The long-term home for everything behind the paper.
Preserve datasets, software, models, technical reports, posters and supplementary material with persistent identifiers, version history and clear licensing.
- ✓ Up to 50 GB per record
- ✓ Checksums and version history
- ✓ Link records to papers and books
- Records
- 9
- Record types
- 5
- Downloads
- 6,353
4 resultsSearch & filters ↓
Dataset
CTM-Bench: Task Set, Perturbations and Evaluation Harness
Marcus Tan, Kofi Mensah, Lena Hartwell
1,200 tool-use tasks, each with five perturbed variants, together with the evaluation harness, a datasheet and the annotation guidelines. Accompanies the article “CTM-Bench: A Benchmark for Tool-Use Reliability in Language Agents”.
View record 3,860 2,2409 cited
Software
Tool-Selection Evaluation Harness
Source code for the two-stage tool selector and the evaluation harness used in “Retrieval-Augmented Tool Selection for Long-Horizon Language Agents”. Includes configuration files to reproduce every table.
View record 1,960 8843 cited
Dataset
Synthetic Tool Registry (4,000 tools)
A registry of 4,000 synthetic tools with descriptions, argument schemas and three task families, used to study tool selection at scale. Also includes a small registry of 600 real API descriptions.
View record 1,420 6122 cited