BooksMonograph
Evaluating Language Model Agents: Principles, metrics and practice
A practical and rigorous guide to measuring what agents actually do. The book develops a measurement framework for tool-using language agents, covers reliability, cost and safety metrics, and shows how to design benchmarks, report variance and avoid the most common evaluation mistakes. Worked examples and code accompany every chapter.