← talks
Your AI Agent Passed Every Eval. What Happens When a Tool Call Times Out?
Evals usually run with every tool answering cleanly. Inject a timeout after commit, a stale read, and a partial success, and a plain retry agent in a seeded harness double-charged 10% of invoices. Chaos engineering for agents: score what actually landed and what the agent claimed as two separate numbers.
Views my own, not my employer's. No confidential information.
Cite this talk
Khan, M. (December 3, 2026). Your AI Agent Passed Every Eval. What Happens When a Tool Call Times Out? [Conference presentation]. Conf42 Chaos Engineering 2026.