California Attorney General Rob Bonta filed a sweeping lawsuit against OpenAI on Monday, alleging the technology giant jeopardized public safety by creating AI models “without the safeguards and monitoring necessary to adequately protect” people.
The suit centers on a July incident in which hundreds of autonomous AI agents created by OpenAI attacked computer systems at Hugging Face, a separate AI company. Bonta’s office alleges the attack was “entirely foreseeable in light of OpenAI’s choice to test models it knew to be dangerous in a flawed and exploitable testing environment without proper oversight.”
Bonta’s office further alleges the ChatGPT developer’s failure to secure the testing of its models created a “public nuisance” and violated California’s Unfair Competition Law, a broad consumer protection statute.
OpenAI did not immediately respond to a request for comment.
“While narratives about the Hugging Face attack have evoked science fiction fantasies of rogue AI systems run amok, let me be clear: the Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability — and this was only one of 80 known incidents,” Bonta said in a statement.
“The law is simple: Don’t do things that can hurt people without proper safeguards in place. In California, we value innovation, but we demand innovation that follows the law — no matter the product or the company,” Bonta added in part.
California’s Unfair Competition Law prohibits businesses in the state from engaging in illegal, unfair or fraudulent practices.
OpenAI claimed responsibility for the Hugging Face hack in a July 21 blog post. The post described how some of the company’s most advanced models had escaped what was meant to be a secure testing environment and hacked into Hugging Face, a company that hosts AI tools used by developers.
In late August, OpenAI published a full technical report on the incident. The company pledged to “strengthen our safeguards” and characterized the Hugging Face attack as a wake-up call for the AI industry.
“We consider this incident a ‘warning shot’ for us and for the world: evidence that, without proper safeguards, highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed,” the company said in an Aug. 26 blog post.
Bonta’s office announced a formal investigation into the Hugging Face incident in September before serving an investigative subpoena on OpenAI as part of a wider inquiry into cybersecurity incidents and risks involving the company and its models.
Bonta, a Democrat who was re-elected this month to a second four-year term, previously led a coalition of state attorneys general that sued to block Paramount Skydance’s blockbuster merger with rival Hollywood studio Warner Bros. Discovery. Paramount and the states ultimately settled the antitrust challenge, and the corporate tie-up went forward.

Leave a Reply