A senior Crown Prosecution Service (CPS) prosecutor cited an imaginary legal precedent in a High Court case, sparking fresh concerns about AI hallucinations infecting the justice system. Ravinder Dhillon referenced a completely made-up case during a dispute over whether a child should be prosecuted for the rape of his younger sister, court documents have revealed.
Her explanation for how the nonexistent case came to be relied on has been called “unsatisfactory” by two senior High Court judges and a “serious failure” by an expert in AI and law. The Guardian understands the reference came from an AI response generated during an internet search.
What Happened in the High Court AI Case?
During the High Court dispute, Ravinder Dhillon, representing the CPS, cited a legal precedent that did not exist. The case concerned whether a child should be prosecuted for the rape of his younger sister. The fake case was apparently generated by an AI tool during an internet search and then used in court submissions.
Two senior High Court judges described Dhillon’s explanation for the error as “unsatisfactory.” An expert in AI and law called it a “serious failure.” The incident adds to dozens of other AI-related errors in court proceedings this year, mostly involving people who are not legally qualified representing themselves, often in employment tribunal cases.
Why AI Hallucinations in Law Are a Growing Concern
AI hallucinations occur when a language model generates false or misleading information that appears credible. In legal contexts, this can lead to citations of nonexistent cases, statutes, or legal authorities. The consequences can be severe, undermining the integrity of court proceedings and wasting judicial resources.
This is only the second known case involving the CPS, the main public agency bringing criminal prosecutions in England and Wales. In February, the CPS admitted that one of its lawyers acting in an extradition case involving two Romanians convicted of minor offenses cited nonexistent legal authorities, likely caused by AI. Those made-up cases were only spotted when opposition lawyers could find no trace of them, and the CPS concluded “the risk of recurrence was low.”
Who Is Affected by AI Errors in the Justice System?
The latest case affects the defendant, the victim, and the broader public trust in the justice system. When prosecutors rely on fake legal precedents, it can lead to wrongful decisions, delays, and appeals. The CPS has acknowledged the error but faces questions about its internal safeguards.
Legal experts warn that without proper verification protocols, AI tools can introduce dangerous inaccuracies into high-stakes legal work. The case also highlights the need for training and oversight for legal professionals using AI-assisted research.
What to Watch Next in AI and Law
Watch for the CPS to review its AI usage policies and implement stricter verification steps. The judiciary may also issue guidance on AI use in courts. As AI becomes more integrated into legal research, the balance between efficiency and accuracy will be critical.
This case serves as a cautionary tale for all legal professionals: always verify AI-generated citations against authoritative sources. The consequences of failing to do so can be serious, as the High Court judges made clear. The background to this story is set out in High-Profile Man's Identity Secrecy Challenged in Court. A related thread runs through AI Hallucination Cited in Asylum Refusal, Judge Warns.
Key Takeaways
- Senior CPS prosecutor cited an imaginary AI-generated case in a High Court dispute.
- Two High Court judges called the explanation “unsatisfactory”; an AI law expert called it a “serious failure.”
- This is the second known CPS case involving AI hallucinations in legal citations this year.
- Most AI-related court errors involve self-represented litigants, often in employment tribunals.
- Legal experts urge stricter verification of AI-generated legal research to prevent future errors.
Comparison of AI Hallucination Cases in UK Courts
| Case | Court | Nature of Error | Outcome |
|---|---|---|---|
| Ravinder Dhillon (CPS) | High Court | Cited imaginary precedent from AI search | Judges called explanation “unsatisfactory” |
| CPS extradition case (February) | Unknown | Cited nonexistent legal authorities likely from AI | Spotted by opposition lawyers; CPS said risk low |
| Various employment tribunal cases | Employment Tribunals | Self-represented litigants cited fake cases from AI | Cases dismissed or adjourned |
The pattern is clear: AI hallucinations are not confined to self-represented litigants but have now penetrated the professional prosecution service. This raises urgent questions about the CPS’s internal review processes and the role of AI in legal research. Earlier coverage in Lawyer Fined for 48 AI-Hallucinated Case Citations in Spain shows how the argument developed. A closer look at the same subject appears in AI Hallucinations in Tasmania's Justice System: The Susan Neill-Fraser.
As the legal sector grapples with these challenges, similar issues are emerging in other high-stakes fields. In Australia, the Erin Patterson mushroom murder appeal cites justice failure, underscoring how legal errors can have profound consequences. Meanwhile, in the UK, the CPS Director apologizes for failings in Simon Levy bail case, highlighting ongoing accountability issues within the prosecution service.
These incidents collectively point to systemic vulnerabilities that require immediate attention. The CPS Director’s apology for failings in the Simon Levy case further illustrates the pressure on the agency to reform its practices. Legal professionals must remain vigilant against the risks of AI-generated content. Anyone following the wider picture can start with AI Hallucination in Home Office Asylum Case Raises Alarms.
FAQ
What is an AI hallucination in legal context?
An AI hallucination occurs when an AI model generates false information that appears credible, such as a nonexistent legal case or statute. In law, this can lead to serious errors if not verified.
How did the CPS prosecutor cite a fake case?
The prosecutor, Ravinder Dhillon, apparently used an AI response from an internet search that included a made-up legal precedent. She then cited it in a High Court dispute without proper verification.
What are the consequences of citing fake cases?
Citing fake cases can undermine court proceedings, lead to appeals, waste resources, and damage public trust. Judges may impose penalties or refer lawyers for disciplinary action.
How can legal professionals prevent AI-related errors?
Always verify AI-generated legal citations against authoritative databases like Westlaw or LexisNexis. Implement peer review and use AI tools with caution, especially in high-stakes litigation.