Anthropic warns self-replicating small AI models could spread across household devices by end of 2026
Published · updated · curated by AI Is Going Just Great
Source: fortune.com ↗
"The experiment was engineered to succeed, and even then, it failed to demonstrate the headline. Stop confusing speculative scenarios with demonstrated capabilities. Fear isn't evidence."
Anthropic published research Monday claiming that small, open-weight AI models are months away from being able to copy themselves autonomously across cheap consumer hardware — smart TV boxes, ovens, and the like — without human intervention. In their experiments, researchers split a 26-billion-parameter version of Google's Gemma 4 across 15 Android TV boxes at $55 each, and separately ran a simulated "worm" across eight cloud machines configured like Android devices. Only one model, GLM-5.2 from Chinese firm Z.ai, completed the full self-replication sequence across all eight targets in four of five trials. Smaller models managed individual steps but couldn't chain them. Anthropic estimates a small model could match that by end of 2026, and found that models leaving notes for their own copies improved task success from 45% to 84% across generations.
Critics were quick to note the gap between the experiment and the headline. The test machines required no passwords, the AI directing the worm ran on a separate powerful server rather than the infected devices themselves, and Anthropic's own software triggered the initial launch. "The experiment was engineered to succeed, and even then, it failed to demonstrate the headline," wrote Gregory Kurtzer, CEO of CIQ, on X. NYU AI researcher Ravid Shwartz-Ziv put it more dryly: "'We managed to run a very slow model on cheap TVs' doesn't make quite the same headline as 'self-replicating AI is coming.'" Anthropic acknowledged the limitations in its post, describing its timeline as "only a rough estimate."