US lawyer sorry after ChatGPT creates fake cases in his court filing

New York-based lawyer Steven Schwartz submitted a brief full of falsehoods generated by the OpenAI chatbot. PHOTO: NYTIMES

NEW YORK - What happened when a United States lawyer used ChatGPT to prepare a court filing? The artificial intelligence (AI) program invented fake cases and rulings, leaving the attorney rather red-faced.

New York-based lawyer Steven Schwartz apologised to a judge this week for submitting a brief full of falsehoods generated by the OpenAI chatbot.

“I simply had no idea that ChatGPT was capable of fabricating entire case citations or judicial opinions, especially in a manner that appeared authentic,” Mr Schwartz wrote in a court filing.

The blunder occurred in a civil case being heard by Manhattan federal court involving a man who is suing the Colombian airline Avianca.

Mr Roberto Mata claims he was injured when a metal serving plate hit his leg during a flight in August 2019 from El Salvador to New York.

After the airline’s lawyers asked the court to dismiss the case, Mr Schwartz filed a response that claimed to cite more than half a dozen decisions to support why the litigation should proceed.

They included Petersen v. Iran Air, Varghese v. China Southern Airlines and Shaboon v. Egyptair.

The Varghese case even included dated internal citations and quotes.

There was one major problem, however: Neither Mr Avianca’s attorneys nor the presiding judge P. Kevin Castel could find the cases.

Mr Schwartz was forced to admit that ChatGPT had made up everything.

“The court is presented with an unprecedented circumstance,” Judge Castel wrote in May.

“Six of the submitted cases appear to be bogus judicial decisions with bogus quotes and bogus internal citations,” he added.

The judge ordered Mr Schwartz and his law partner to appear before him to face possible sanctions.

‘Ridiculed’

In a filing on Tuesday, ahead of the hearing, Mr Schwartz said that he wanted to “deeply apologise” to the court for his “deeply regrettable mistake”.

He said his college-educated children had introduced him to ChatGPT and it was the first time he had ever used it in his professional work.

“At the time that I performed the legal research in this case, I believed that ChatGPT was a reliable search engine. I now know that was incorrect,” he wrote.

Mr Schwartz added that it “was never my intention to mislead the court”.

ChatGPT created referenced past cases in the legal brief - none of which could be found by the judge, as they were fake. PHOTO: AFP

ChatGPT has become a global sensation since it was launched in late 2022 for its ability to produce human-like content, including essays, poems and conversations from simple prompts.

It has sparked a mushrooming of generative AI content, leaving lawmakers scrambling to try to figure out how to regulate such bots.

A spokesman for OpenAI did not immediately respond to a request for comment on Mr Schwartz’s blunder.

The story was first reported by The New York Times.

Mr Schwartz said he and his firm, Levidow, Levidow & Oberman, had been “publicly ridiculed” in the media coverage.

“This has been deeply embarrassing on both a personal and professional level as these articles will be available for years to come,” he wrote.

Mr Schwartz added: “This matter has been an eye-opening experience for me, and I can assure the court that I will never commit an error like this again.” AFP

Join ST's Telegram channel and get the latest breaking news delivered to you.