AI Is Going Just Great
← Timeline
·2w agoConcerningMajor

UK Crown Prosecutor Cites Nonexistent Case Law to High Court After AI Search

Published · updated · curated by AI Is Going Just Great

Source: theguardian.com ↗ · archived copy ↗

"This was used as a legal source to argue for the prosecution of a child and that legal source doesn't exist: that's a serious failure."

A senior Crown Prosecution Service lawyer cited a fabricated legal precedent in a high court dispute over whether to prosecute an 11-year-old boy for the rape of his younger sister. Ravinder Dhillon referenced "CPS – R v J [2024] EWCA Crim 3529" in support of the prosecution. The case does not exist. The Guardian reports the citation came from an AI-generated summary returned during an internet search. Two senior high court judges called Dhillon's explanation "unsatisfactory"; an AI and law expert called it "a serious failure."

This is the second known hallucination incident involving the CPS, which in February admitted a lawyer in an extradition case cited nonexistent legal authorities and concluded at the time that "the risk of recurrence was low." The latest incident pushes a UK court AI-error tracker maintained by Doughty Street Chambers barrister Matthew Lee to 101 entries. Lee describes confirmed cases as likely the "tip of the iceberg," since many lower court decisions are never published. The CPS, for its part, says it has a strict AI policy ensuring the technology "is not used to make legal decisions" and that "case law must be cited from trusted legal sources."