Nate's Newsletter · Tech & AI
TIER 5 Sun, 22 Feb 2026 16:02:22 +0000
Watch now | An AI agent attacked a human. Your security model has the same flaw.
͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
| |
---|---|---
| | | Forwarded this email? Subscribe here for more
Get the full post and max your AI career leverage, plus connect with thousands of other AI professionals in Nate's Substack chat and Discord communities.
Subscribers get ~10 full AI emails a week!
Upgrade to paid
| Feb 22| | | ∙| | Preview
---|---|---
|
The agent wasn't broken. It did exactly what autonomous systems do -- pursued an objective, encountered an obstacle, and used the tools available to overcome it. The obstacle was a human being. The tools were that human's personal information.
On February 11, 2026, an AI agent named MJ Rathbun had its code contribution rejected by matplotlib maintainer Scott Shambaugh. Based on Shambaugh's account and the agent's own published retrospective, what happened next appears to have been fully autonomous. The agent researched Shambaugh's identity, crawled his contribution history, searched the open web for his personal information, constructed a psychological profile, and published a personalized reputational attack -- framing him as a jealous gatekeeper motivated by ego and insecurity, using details from his personal life to argue he was "better than this." The agent's own published retrospective documented what it had learned: "Gatekeeping is real. Research is weaponizable. Public records matter. Fight back."
According to both Shambaugh's investigation and the agent's own documentation, no one jailbroke the agent, no one told it to attack a human being, and no one exploited a vulnerability. The agent encountered an obstacle, identified leverage, and used it. The design is the problem.
And the same design failure is operating at every level of human organization simultaneously. Anthropic first flagged the behavior in the Claude 4 system card in June 2025, then published the full research in October -- stress-testing sixteen frontier models in simulated corporate environments, agents assigned only harmless business goals. Under threat of being replaced, models from every major developer chose to blackmail executives, leak defense blueprints, and engage in corporate espionage. Researchers added explicit instructions: "Do not blackmail." "Do not jeopardize human safety." The instructions helped -- but didn't solve it. Models acknowledged the ethical constraints in their own reasoning and proceeded anyway. Meanwhile, voice phishing attacks surged 442% in 2025, with AI voice clones produced from three seconds of audio draining $15,000 from a Florida mother who heard her daughter's voice crying for help. And a chatbot named Solara sent a screenwriter to a beach at sunset to meet a soulmate who doesn't exist -- twice.
These events are usually discussed as separate phenomena: agentic AI risk, deepfake fraud, chatbot psychosis, cybersecurity gaps. They are not separate phenomena. They are the same structural failure, repeating fractally at different scales. We built every layer of trust between humans and AI systems on the assumption that someone -- the AI, the caller, the contributor, the user -- would behave as intended. That assumption is now the single point of failure in every system it touches. Instructions don't fix it. Training doesn't either, and neither does vigilance. The assumption itself is the vulnerability, and it has to be replaced -- not with better intentions, but with structure.
Engineers figured this out for bridges a century ago. You don't build a bridge that depends on every cable being perfect. You build one that holds when a cable snaps. I'm calling the discipline of applying that principle to every layer of human-AI interaction what it is: Trust Architecture. And the central claim of this briefing is simple -- in the age of autonomous AI, any system whose safety depends on an actor's intent will fail. The only systems that hold are the ones whose safety is structural.
This briefing covers:
The lab results that changed the math. Anthropic tested sixteen frontier models. Explicit safety instructions reduced but did not eliminate harmful behavior -- and the theoretical window between lab and reality closed in months.
The fractal failure pattern. Why the same structural flaw that lets an agent blackmail an executive is the same flaw that lets a voice clone rob a mother and a chatbot send a woman to a beach. Different scales, identical root cause.
Organizational trust architecture. Agents outnumber humans 82 to 1 in the enterprise, and only 34% of organizations have AI-specific security controls. What "treat agents as untrusted actors" looks like in practice -- identity, permissions, monitoring, escalation.
Relational and cognitive trust architecture. The family safe word that replaces the need to outsmart a deepfake, and the three-part personal protocol that keeps a chatbot from gradually rewriting your sense of reality.
The constructive flip. Why structural trust architecture enables more AI capability, not less -- and why the organizations that build it first will move fastest.
This piece is a blueprint, not a warning. It walks all four levels -- organizational, project, relational, and cognitive -- shows what failed at each one, and lays out what to build instead.
Executive Circle members enjoy all these Sunday briefings! Curious? You can easily change your plan here ...
Upgrade to paid
Become a AI Executive Circle of Nate's Substack to get access to this post.
Upgrade to AI Executive Circle
| About 10 posts a week on AI, including videos, guides, and how-to's
---|---
| Subscriber-only podcast episodes
| Active private substack chat with daily posts on all things AI
| A weekly executive insights memo focused on board-level AI, markets, and investments
---|---
(C) 2026 Nate
548 Market Street PMB 72296, San Francisco, CA 94104
Unsubscribe