Georgia Court Order Contains AI-Hallucinated Legal Citations
A Georgia Supreme Court appeal hearing exposed significant citation errors in a trial court order, with evidence suggesting AI-generated hallucinations were involved. During arguments in a murder conviction appeal, Chief Justice Nels S.D. Peterson identified serious problems with the trial court's order denying a new trial.
Key Details from the Hearing
According to the source material, Chief Justice Peterson stated the order contained:
- "At least five citations to cases that don't exist"
- "At least five more citations to cases that do not support the proposition for which they're cited"
- "Three quotations that don't exist"
The prosecutor, Leslie, responded that her initial submitted order had been revised and took no responsibility for the errant citations. However, Chief Justice Peterson countered: "Those nonexistent cases were cited in your initial brief opposing the motion for a new trial."
Documentation Available
The source indicates two key documents are available for examination:
- A 33-page order denying a new trial
- A 37-page proposed order from the state
This incident highlights the risks of using AI tools for legal research and citation without thorough verification. While the source doesn't specify which AI tool was used, the pattern of hallucinated cases and misattributed quotations matches known limitations of current large language models in legal contexts.
📖 Read the full source: HN LLM Tools
👀 See Also
Claude Code v2.1.203: Major Bugfix Release with Background Session Recovery and Performance Improvements
Claude Code v2.1.203 fixes background session stalls on macOS, token expiration recovery, PATH inheritance issues, and reduces binary size by 7 MB with startup memory savings.
AirTag in rare book tracks Amazon's destructive AI training scanning operation
A bookseller planted an AirTag in a rare book sold in bulk, tracking it to an Amazon AI facility where books are torn apart and scanned for training data.
Claude Opus 4.6 Breaks CLAUDE.md File References
Users report that Claude Opus 4.6 no longer automatically loads files referenced in CLAUDE.md, forcing manual intervention for each file.
Open-source LLMs outperform Claude Opus 4.6 in trading strategy generation at lower cost
A Reddit user tested 10 LLMs on generating trading strategies, finding open-source models outperformed Claude Opus 4.6 despite being 10x cheaper. Minimax 2.5 and Gemini 3.1 topped the leaderboard.