Turn-Time Budget for a Local Coding Agent: what a measured tokens/second figure buys you in tool-call turns

Your local model answers a chat question in a couple of seconds and feels fine. You wire it into an agent that needs thirty tool calls to finish one refactor, and around the eighth request the client gives up with a read timeout, or the patch comes back cut in half because generation stopped mid-function. Nothing in the server log looks like an error. Restart the session with a shorter conversation and it completes. ...

November 8, 2026 · 12 min · baeseokjae