Dataset
CTM-Bench: Task Set, Perturbations and Evaluation Harness
Marcus Tan, Kofi Mensah, Lena Hartwell
1,200 tool-use tasks, each with five perturbed variants, together with the evaluation harness, a datasheet and the annotation guidelines. Accompanies the article “CTM-Bench: A Benchmark for Tool-Use Reliability in Language Agents”.
View record 3,860 2,2409 cited