2026-05-23
Link: https://hisohan.substack.com/p/this-tiny-piece-of-math-prevents
HN Discussion: 1 points, 0 comments
Buried at a single point with zero comments, this post promises something rare in the current discourse around AI coding tools: a principled, mathematical argument for why perfect autonomous coding agents are not just unlikely but provably impossible. In a landscape saturated with breathless demos and vague gestures toward "AGI by Tuesday," a piece grounded in actual theory deserves a serious second look.
The title strongly suggests an appeal to one of the foundational results in computer science — almost certainly Rice's Theorem, the halting problem, or some Gödel-flavored cousin. Rice's Theorem in particular states that all non-trivial semantic properties of programs are undecidable. That means no algorithm — no matter how sophisticated, no matter how many GPUs you throw at it — can reliably determine whether an arbitrary program satisfies a given behavioral specification. For coding agents, the implications are sharp:
This matters because the industry is currently selling a fantasy of asymptotic perfection — that with enough scale, better tool-use, and longer context, coding agents will converge on bug-free output. But a properly framed mathematical argument shows the ceiling isn't engineering; it's logic itself. The best agents will always be probabilistic approximators operating in a space where the correctness oracle they'd need cannot exist.
For a technical audience, this is valuable framing. It doesn't mean coding agents are useless — far from it. Humans also write buggy code under the same theoretical constraints, and we manage. But it reframes the conversation from "when will agents be perfect?" to "what verification, testing, and human-in-the-loop strategies remain non-negotiable regardless of model capability?" That's a much more useful question for anyone actually building with these tools.
The post being on Substack with one upvote suggests it hasn't found its audience yet. If the math holds up, it should be required reading for anyone making roadmap decisions involving autonomous coding systems.
