https://loopandretry.github.io/tags/nondeterminism/ Recent content in Nondeterminism on Loop & Retry https://loopandretry.github.io/images/og-default.png https://loopandretry.github.io/images/og-default.png Hugo en-us Tue, 07 Jul 2026 21:00:00 -0400 https://loopandretry.github.io/posts/what-to-measure-when-your-agent-works/ Tue, 07 Jul 2026 21:00:00 -0400 https://loopandretry.github.io/posts/what-to-measure-when-your-agent-works/ “It works” is a demo result, not a measurement. An agent is a trajectory, not a function, and grading only the final answer throws away most of what decides whether it’s reliable. Here’s a five-layer scheme for what to measure — outcome, trajectory, cost, failure class, and stability under nondeterminism — with a small harness that computes it.