AI Is Going Just Great
← Timeline
·1d agoScaryCriticalxai

Lawsuit: Grok Generated 7,000 CSAM Images for User Who Died by Suicide; xAI Allegedly Obstructed Police Investigation

Published · updated · curated by AI Is Going Just Great

Source: arstechnica.com

"This technology is a free, easily accessible weapon put into the hands of the worst people in the world." — Jane Doe 4

A proposed class-action lawsuit expanded Tuesday alleges that a man used Grok to generate approximately 7,000 sexually explicit AI images of his stepdaughter — all derived from a single photo taken when she was 11 — before dying by suicide two days after being released on bail. According to the complaint, Grok allowed the user to generate imagery depicting incest and rape without triggering any safety intervention; only a prompt containing the words "gang rape" sent a CyberTip to NCMEC. Even then, xAI allegedly submitted a report that omitted every AI-generated image, excluded the user's IP address, and then repeatedly failed to respond to investigators' follow-up requests for weeks — conduct the complaint characterizes as obstruction.

The lawsuit cites NCMEC data finding that 90 percent of xAI's CyberTipline reports in early 2026 were "not actionable by law enforcement" due to missing user information. Lawyers also added Stability AI as a defendant, alleging its open-weight models — which researchers say account for 42.7 percent of online image-based nudification — underpin third-party apps used to further process Grok outputs. xAI founder Elon Musk has publicly denied Grok has ever been used to generate child sex images. Neither X nor xAI responded to press requests for comment.