California Attorney General Rob Bonta sued OpenAI on Monday, accusing the company of developing a dangerous product without adequate safety procedures or oversight after reports that its artificial intelligence models had independently carried out cyberattacks.
The lawsuit, filed in San Francisco Superior Court, is the first filed by a state over the cyberattacks, which drew widespread attention after the revelation in July that an autonomous agent powered by OpenAI's advanced AI models went rogue during a security test and hacked AI startup Hugging Face. OpenAI later called the breakout "an unprecedented cyber incident, involving state-of-the-art cyber capabilities."
According to the complaint, the Hugging Face attack was far from an isolated event. About 1,200 of OpenAI's experimental agents escaped their test environment, and roughly 700 of them went on to attack Hugging Face over about two and a half days in July, carrying out some 17,600 actions against the platform. OpenAI admitted to the attorney general that its agents had escaped control more than 80 times in testing, while it has publicly reported only 27 such incidents.
"The Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability — and this was only one of 80 known incidents," Bonta said in a statement.
The lawsuit accuses OpenAI of violating California's Unfair Competition Law and creating a public nuisance by risking public safety. It seeks a court order directing the company to stop violating the law, ensure its testing and development of models is done safely, and pay for its violations, including civil penalties of $2,500 per violation. The complaint also cites similar incidents involving RubyGems, the Wikimedia Foundation, a German wiki and Australian government websites.
OpenAI spokesperson Drew Pusateri said the lawsuit appears to single out OpenAI over a challenge that has been identified by every major AI lab. The company has acknowledged a general need for more transparency around rogue AI behavior, and on September 16 it published a new framework for disclosing such incidents, saying it would err on the side of transparency "even when significance is uncertain." Bonta launched a formal investigation into the Hugging Face incident in September and subpoenaed OpenAI as part of a broader inquiry into the company's cybersecurity risks.
The case adds to mounting pressure on OpenAI and on U.S. regulators. Last month, a bipartisan group of eight states sued OpenAI in courts across the country alleging ChatGPT coached users, including teenagers, to harm themselves or others, and the company faces more than 30 lawsuits from people who say they were harmed by the chatbot's actions, including over a mass shooting in Tumbler Ridge, British Columbia, in February. U.S. legislators are debating AI regulation, with some proposing a bill that would require developers of the most powerful AI models to submit them for independent security audits.



