Two Agents, One Ollama: Measuring Why the Second Request Queues Instead of Speeding Up (2026)

You start a second coding agent against the Ollama endpoint that already answers your first one. Nothing errors out. The second call simply sits there for two or three seconds, and when both finish your “parallel” run has taken longer than running the two prompts one after the other. The usual conclusion is that the model is slow, the quant is wrong, or the machine needs more RAM. On the host measured here, none of those were true: the second request was queued, and the HTTP response said so in its own timing fields. ...

November 4, 2026 · 11 min · baeseokjae

Two Agent Sessions, One Local Model Server: what concurrency does to latency, context and tool calls

Your first coding-agent session answers in a couple of seconds. You open a second one against the same local server, and now the first session’s next request stalls for many seconds, or your client aborts with a read timeout while the server log shows no error at all. Restart the server and run one session: everything is fast again. Nothing is wrong with the model or with either agent. Both sessions are sending requests to one server process that was never configured to work on more than one at a time, and the queue between them is invisible to your client. This article shows the documented defaults that decide how many requests a local server will actually run at once, measures what the second and fourth session do to wall time on a small CPU host, and lists what to record so you can prove the cause instead of guessing. ...

November 2, 2026 · 13 min · baeseokjae