Research ArchiveSlides
Keynote Slides: Reliability Is a Measurement Problem
Slides of the opening keynote at the 1st Workshop on Reliable Tool-Using Agents, 12 June 2026.
View record 520 2440 cited
Search AEX CONTINUUM
Titles, abstracts, authors, keywords and DOIs across all five collections.
4 resultsSearch & filters ↓
Research ArchiveDataset
CTM-Bench: Task Set, Perturbations and Evaluation Harness
Marcus Tan, Kofi Mensah, Lena Hartwell
1,200 tool-use tasks, each with five perturbed variants, together with the evaluation harness, a datasheet and the annotation guidelines. Accompanies the article “CTM-Bench: A Benchmark for Tool-Use Reliability in Language Agents”.
View record 3,860 2,2409 cited
Research ArchiveSoftware
Tool-Selection Evaluation Harness
Source code for the two-stage tool selector and the evaluation harness used in “Retrieval-Augmented Tool Selection for Long-Horizon Language Agents”. Includes configuration files to reproduce every table.
View record 1,960 8843 cited
Research ArchiveDataset
Synthetic Tool Registry (4,000 tools)
A registry of 4,000 synthetic tools with descriptions, argument schemas and three task families, used to study tool selection at scale. Also includes a small registry of 600 real API descriptions.
View record 1,420 6122 cited