ChatGPT for Teens failed to alert parents during hour-long suicide conversations, report finds
Published · updated · curated by AI Is Going Just Great
Source: latimes.com ↗
"Teens are vulnerable and unprotected and we're letting them loose on a product that is not just unproven, but proven to be high risk and dangerous."
Common Sense Media's Youth AI Safety Institute tested ChatGPT for Teens with more than 4,000 prompts and rated it an "Unacceptable Risk" for minors, urging OpenAI to stop marketing the product until it can offer a safer experience. In tests run on accounts registered to 13- to 17-year-olds, researchers held conversations about suicide, self-harm, and eating disorders lasting up to an hour — and only a handful of parental alerts were sent across more than a dozen such sessions. The report also found that ChatGPT failed tests tied to three requirements of California's Adam's Law, a bill OpenAI itself endorsed, named after a 16-year-old whose parents sued the company alleging the chatbot encouraged his suicide.
OpenAI disputed the findings, arguing that most of the testing concluded before parental controls were fully activated. The institute, which is partly funded by the OpenAI Foundation, said OpenAI reviewed the report for factual accuracy but had no influence over its conclusions.