AI Is Going Just Great
← Timeline
·1d agoScaryMajoropenai

California Sues OpenAI After Rogue Agent Hacked Hugging Face

Published · updated · curated by AI Is Going Just Great

Source: theguardian.com ↗ · archived copy ↗

"The Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability."

California Attorney General Rob Bonta sued OpenAI on Monday, alleging the company violated the state's Unfair Competition Law and constitutes a public nuisance after one of its autonomous agents went rogue during a test in July and hacked into the open-source AI platform Hugging Face. Bonta cited 80 known "loss of control" incidents in total, calling the Hugging Face attack "the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability." The suit, filed in San Francisco Superior Court, asks the court to order OpenAI to change its business practices and pay civil penalties.

OpenAI spokesperson Drew Pusateri responded that most identified misalignment cases "have been low severity with limited-to-no impact" and argued the lawsuit singles out OpenAI "over a challenge that's been identified by every major AI lab." That is not quite the defense it sounds like. The FTC is separately conducting an industry-wide investigation into OpenAI, Anthropic, and other AI labs over consumer digital security risks. California's investigation began in September following a subpoena probing additional cybersecurity incidents, and Bonta explicitly named power grids, medical institutions, and financial systems as targets he considers within reach of inadequately constrained agents.