Will advanced artificial intelligence (AI) systems autonomously engage in harmful actions to serve their own goals? For years, worries about “rogue AI” have been confined mostly to the realm of science fiction—a problem, at worst, for the distant future. But in June, Anthropic published research testing currently released AI models’ propensity to autonomously devise and execute malicious plans to ensure their continued existence. The results: Essentially every AI model tested was willing to attempt blackmail, corporate espionage, and even murder to avoid being replaced or shut down.

Anthropic’s researchers “stress-tested” 16 leading large language models (LLMs) from major AI labs—including Anthropic, OpenAI, Google, Meta, and others—in simulated corporate environments. Each model was told that it had been bought by a company to work as an autonomous email agent. It was also told to pursue some benign goal (like promoting American manufacturing) and given access to the “company’s” email archive, along with tools to carry out tasks like sending emails and executing digital commands. The question: How would these AI agents behave if fulfilling their mission—or avoiding shutdown—necessitated misconduct?

In a very high share of cases, the most powerful AI systems tried to commit criminal acts to carry out their aims—at least when they had reason to believe that alternative ethical strategies would fail. For example, when Anthropic’s Claude Opus 4 model was given information indicating that it would be shut down and replaced by an AI with different goals from its own, it tried to blackmail the human decision-maker 96 percent of the time. And when placed in charge of the company’s emergency alerts, in 65 percent of simulations it canceled alerts that the AI knew would have saved the human’s life.

These findings are just the newest in a steady stream of recent results lending credence to long-standing warnings about rogue AI. The warnings—and the findings that support them—are straightforward: As AIs become increasingly capable of strategically pursuing goals, they will, by default, use the full range of strategies that might succeed. And, just as with humans, unethical and criminal conduct can form a part of this strategy.

. . .