Model choice is not an authorization layer

2026-06-11

Link: https://github.com/hugoii/llm-agent-audit/blob/master/docs/model-choice-is-not-an-authorization-layer.md

HN Discussion: 2 points, 0 comments

This one slipped past the front page with two upvotes, but it's exactly the kind of unglamorous security writing that the LLM-agent ecosystem desperately needs right now. The thesis is in the title: which model you route a request to is not a security boundary. And yet, increasingly, that's how teams are treating it.

You can see the pattern everywhere. A team builds an agentic system, notices that the cheap small model occasionally does something dangerous, and "fixes" it by routing sensitive operations to a bigger, smarter model that's "less likely" to be tricked. Or the inverse — they restrict a tool to a "trusted" fine-tuned model, assuming attackers can't reach it. Both are variations of the same fallacy: treating probabilistic alignment as access control.

A technical audience should care about this for a few reasons:

The likely concrete recommendation: put a deterministic policy layer (allowlists, OPA-style rules, signed tool manifests) between the model and any side-effectful tool call, and treat the model's output as untrusted user input — because functionally, that's what it is once any external content has touched the context window.

This is the security-architecture conversation that should be happening loudly right now, while teams are still wiring up MCP servers and tool-calling pipelines, rather than after the first big agent-driven data exfiltration incident.

Why it deserves more upvotes: A crisp, principled framing of a security antipattern that's quietly being baked into production agent stacks — exactly the kind of post that prevents the next class of incidents.

All newsletters