ToolReplay: Auditing an Agent Session for Non-Determinism and Scope Overreach
If you let a coding agent run unattended, the only durable record of what it did is the transcript of its tool calls. Dashboards show you totals; the transcript shows you the sequence. ToolReplay is a small, dependency-free Python CLI that reads one such transcript and answers three narrow questions about it: did the same call ever return two different answers, did the agent repeat a call that could not have changed anything, and did it call a tool it was never granted. It reads a JSON Lines file, and it does the work offline. ...