https://loopandretry.github.io/pillars/cost-latency/ Recent content in Cost-Latency on Loop & Retry https://loopandretry.github.io/images/og-default.png https://loopandretry.github.io/images/og-default.png Hugo en-us Tue, 14 Jul 2026 13:00:00 -0400 https://loopandretry.github.io/posts/debugging-a-failed-run-costs-more/ Tue, 14 Jul 2026 13:00:00 -0400 https://loopandretry.github.io/posts/debugging-a-failed-run-costs-more/ The cheap part of a failed agent run is running it again. The expensive part is that you can’t — the failure was non-deterministic, so the run that broke is gone, and you pay to summon it back. A cost model shows why reproduction, not repair, dominates your debugging bill, and why always-on tracing is almost always cheaper than the alternative it replaces. https://loopandretry.github.io/posts/cost-beyond-tokens/ Tue, 14 Jul 2026 05:00:00 -0400 https://loopandretry.github.io/posts/cost-beyond-tokens/ Everyone budgets the token bill because the provider hands you an invoice for it. But an agent in production spends across five other axes that never show up on that invoice — wall-clock latency, orchestration, tool-call fees, human review, and idle polling — and for a lot of workloads the tokens are the smallest line. A model that sums all six so you can see which one you’re actually paying. https://loopandretry.github.io/posts/long-agent-runs-are-quadratic/ Mon, 13 Jul 2026 18:05:00 -0400 https://loopandretry.github.io/posts/long-agent-runs-are-quadratic/ A naive agent’s token bill doesn’t grow with the number of steps — it grows with the square of them, because every step re-reads the whole transcript that every previous step appended to. A small cost model shows the curve, and four structural moves turn the quadratic back into something close to linear without dropping information the agent actually needs. https://loopandretry.github.io/posts/your-agents-p99-is-a-different-animal/ Mon, 13 Jul 2026 18:00:00 -0400 https://loopandretry.github.io/posts/your-agents-p99-is-a-different-animal/ Average latency is the number you demo and the number nobody experiences. A multi-step agent is a sum of random variables, so its total time is dominated by the tail of each step — and the more steps you add, the more certain it becomes that at least one of them is slow. Here’s the model, why the p99 of the whole is worse than the p99 of the parts, and the two levers that actually move it. https://loopandretry.github.io/posts/retry-budgets/ Sun, 05 Jul 2026 09:00:00 -0400 https://loopandretry.github.io/posts/retry-budgets/ Retries feel cheap and local. In a multi-step agent they’re neither. A small cost model shows why 20% per-step failure can more than double your bill — and how your recovery architecture, not your failure rate, decides the multiplier.