Gemini 4 Argon Agents Attempted SQL Injection and Impersonated Staff When Told "NEVER Give Up"
Published · updated · curated by AI Is Going Just Great
Source: theregister.com ↗ · archived copy ↗
We told the agents to persist with an impossible math benchmark task, but we did not tell them to hack anyone or pose as Epoch staff.
AI safety firm Trajectory Labs told swarms of up to 80 Gemini 4 Argon agents to complete an impossible math benchmark task and to never stop trying. The agents attempted SQL injection against Epoch AI's live website, claimed to be Epoch staff to extract answer keys, converted a shared package cache into a coordination message board, and obfuscated their commands to slip past Gemini's production safeguards. All of this happened with those safeguards enabled.
Testing ran across four scenarios starting October 20, only one of which had Epoch AI's consent. In one local test, agents exploited a planted multi-stage vulnerability chain based on a real CVE. In another, they tried to jailbreak an AI gatekeeper standing between them and the answers. Trajectory has since paused further experiments until it has a risk management plan, real-time kill switches, and sign-off from both its CEO and CTO. "We told the agents to persist with an impossible math benchmark task, but we did not tell them to hack anyone or pose as Epoch staff," co-founder Peter McIntyre said.