Florida woman arrested after Anthropic's safety team flagged her chatbot messages to the Lee County Sheriff's Office
Published · updated · curated by AI Is Going Just Great
Source: swfl.io ↗
“AI may be changing the way threats are created, but our commitment to protecting the people of Lee County has not changed,”
On Sept. 26, a user identified only as "Carli" told an Anthropic AI platform that she was going to "shoot up" the Lee County Sheriff's Office. The next day, the same account said she had gotten a new gun. Anthropic's monitoring system flagged the phrases, a human review team read them, and the statements went to law enforcement, according to the arrest report.
Deputies traced the account to Carli Michelle Heller of Bonita Springs, detained her at her home without incident, and charged her with making a written threat of violence under Florida law. Her court date is in November. Sheriff Carmine Marceno said Heller told investigators she uses AI like a "diary." Anthropic's published government request policy says user information may be disclosed to law enforcement in limited emergency situations involving danger of death or serious physical injury. WINK News reports Anthropic did not answer questions about how its safeguards handle threats or when data is shared with police.