Generative AI Hallucination in Court Filing May Jeopardize Case Against BART

More than 1,000 US legal cases in which generic AI produced hallucinated content were detected from Q2 2023 to May 19, one researcher found.

The screen shows ChatGPT app in this photo illustration. Oleksii Pydsosonnii/The Epoch Times

SAN FRANCISCO—A California attorney was sanctioned $1,000 for three nonexistent cases referred to in a court filing that indicated possible use of artificial intelligence (AI) that hallucinated, an issue increasingly seen in courts.

“The Court does not prohibit or oppose the use of artificial intelligence in legal advocacy, so long as counsel independently verifies the accuracy of AI-generated content.” U.S. magistrate judge Thomas S. Hixson wrote in the order on May 6.