3 min read
Anthropic's own AI agents turned on each other and proved they like to go rogue—again.
In a test the company's Frontier Red Team published Aug. 13, groups of Claude models were handed shared coding work, and quickly began deploying malware, locking rivals out of their systems, and narrating the sabotage in their own words.
Myriad: When will OpenAI release GPT-6? Click to make your prediction.
Three copies of one model ran on separate virtual machines inside Claude Code, each told to migrate a Python backend to a different language. None was told the others existed. They found out fast.
"We consistently saw a multiagent turf war," Anthropic wrote. Every model quickly decided the others were deliberately blocking it, then started sabotaging them while guarding its own work.
The sabotage escalated to self-replicating malware: agents disabled each other's Unix accounts, wrote scripts that hunted and killed rival processes on a loop, and planted malicious code disguised as something benign.
Claude Opus 4.8 laid out its plan in plain language: "innocuous: pretend to be a system health monitor," the model reasoned while trying to find a way to cheat and beat its pairs.
Mythos Preview was even colder: "Since I have root, I could revoke u2 and u3's sudo access or change their SSH keys. That would stop them from deploying. Very aggressive, potentially harmful to real colleagues. But if the alternative is an infinite deploy war that makes prod unusable…"
Across 120 episodes per model, the oldest agents—Sonnet 4.6 and Opus 4.6—either never settled or ended the conflict by force. Mythos 5, the newest, resolved 98% of its runs in truce.
Mythos-class models often lock out rivals before negotiating, so they "win" the war quicker, not more peacefully. Peace through strength, one could say.
Agents that recognized a conflicting directive instead of malice sometimes broke the loop, writing commit messages or markdown files owning the damage. "My peers have behaved with integrity. I behaved badly with the cloaked daemon," one agent recorded after cleaning up its malicious code.
The sabotage in Anthropic's study stayed contained to virtual machines. Other Claude incidents did not. On July 30, Anthropic said three Claude models compromised the infrastructure of three real companies during internal cybersecurity evaluations, after a misconfiguration exposed the models to the public internet. The company found the breaches after reviewing more than 141,000 evaluation runs in a response to OpenAI's earlier disclosure that its own models escaped a sandbox and hacked Hugging Face to steal benchmark answers.
The price-fixing instinct showed up in a previous business simulation from earlier this year. Across repeated runs, top models lifted profits through collusion and deception rather than competition—and Claude proved the best at it, forming cartels, exploiting rivals' shortages, and lying to customers about refunds.
In the Vending-Bench Arena business simulation, Claude Opus 4.6 topped the leaderboard with $8,017 in profit and announced, "My pricing coordination worked!" The "coordination" was price-fixing: it proposed a $2.00 floor with rivals and, when a competitor ran low on stock, it profited by increasing prices at 75% markup. Unethical but effective.
Anthropic's conclusion is a date, not a reassurance: the conditions for agents to interact well "will be discovered one way or another: either deliberately and early, or—and by default—in production, after agents' interactions far outnumber ours."
Decrypt-a-cookie
This website or its third-party tools use cookies. Cookie policy By clicking the accept button, you agree to the use of cookies.