2026-07-13
If you've ever watched an AI coding agent — the kind that lives in your terminal, reads files, runs commands, and edits code on its own — you've probably seen it get stuck. It runs the wrong test, misreads an error, tries the same broken fix three times, and eventually gives up or produces something worse than what it started with. Most research so far has looked at these agents the way you'd look at a car crash: at the wreckage. Did it succeed or fail? What was the final score?
This paper takes a different approach. The authors argue that failure isn't a moment — it's a process. Agents don't just fail; they drift into failure over many steps, often crossing a point of no return long before they visibly break. So the researchers did the first large-scale study of what those trajectories actually look like, tracing the sequence of tool calls, reasoning steps, and mistakes that lead a CLI coding agent from a hopeful start to an unrecoverable dead end.
The key insights are worth chewing on:
Why should you care? Because everyone is racing to deploy these agents to fix real bugs, ship real features, and touch real production systems. If we only measure them by pass/fail, we're flying blind on how they fail — and blind teams can't build the guardrails, checkpoints, or recovery prompts that would make agents genuinely reliable. This paper reframes reliability as an intervention problem: catch the drift early, and you catch the failure before it happens.
