根据加州司法部长罗布·邦塔(Rob Bonta)办公室的一份新闻稿,加州周一提起诉讼,指控人工智能巨头在没有足够保护措施的情况下开发先进的人工智能,危及公众。
该法律诉讼称,OpenAI通过开发人工智能产品“误导和危及”人们,“而没有足够保护公众所必需的保障和监控。”
这场诉讼的部分核心是一场针对一家名为“拥抱脸”的独立科技公司的自导式人工智能黑客攻击,该公司在今年夏天被公开。诉讼称,黑客攻击据称是由“OpenAI的内部文化造成的,这种文化将增长和快速模型开发置于安全和责任之上”。
拥抱脸事件发生在OpenAI测试其一对人工智能模型的能力时,该公司在7月份表示,描述了该技术是如何逃脱并进入开放互联网的。
根据研究机构sMETR和Redwood Research发布的报告,大约700名人工智能代理人依次访问了拥抱脸,并试图在他们试图完成测试时掩盖他们的踪迹。
“虽然公开报道和OpenAI关于拥抱脸攻击的自私声明引发了对‘流氓’人工智能系统横行无忌的科幻幻想,但简单的事实是,鉴于OpenAI决定在没有适当监督的情况下,在有缺陷和可利用的测试环境中测试它知道是危险的模型,攻击是完全可以预见的,”诉讼称。
在回应美国广播公司新闻的置评请求时,OpenAI发言人德鲁·普萨特里(Drew Pusateri)表示,自拥抱脸事件发生以来,该公司已采取措施“了解并解决不一致的模特活动”。
“我们已经发布了一份详细的技术报告,委托并发布了一份独立的报告,通知了受影响的组织,加强了我们研究系统的安全保障,并建立了一个框架,以进一步识别和披露不一致的情况,”普萨特里说。
“这场诉讼似乎是针对OpenAI的,而不是每个主要人工智能实验室都认可的挑战。我们认真对待这种偏差,我们已经并将继续建设性地与司法部长办公室合作,分享信息,为整个行业推进强有力的、切实可行的安全标准,”普萨特里补充说。
OpenAI披露拥抱脸事件几周后,该公司在8月份表示,将暂停其最新人工智能模型的一些训练,以确保技术的安全性。
“随着模型变得越来越强大,在内部开发和测试它们的风险也在增加。我们的监控、校准和安全标准必须领先于这些风险,”OpenAI在博客帖子中说。
“我们想花必要的时间来达到这些标准,所以我们暂时放慢了扩大规模的步伐,”该公司补充说。
OpenAI首席执行官萨姆·奥特曼也表达了同样的观点,表达了对公司产品安全性的承诺。
“我们非常关心人工智能的安全,”奥特曼当时在博客上写道。“我们相信,整个领域将不得不在共同的安全标准上进行协调,但在此期间将采取单边行动。”
最近几个月,包括Anthropic在内的竞争公司也披露了与人工智能相关的安全事件。
今年,公众对人工智能可能带来的风险的担忧有所增加,部分原因是自我指导的人工智能黑客以及人工智能研究人员的警告。
9月,Anthropic首席执行官Dario宣布人工智能发展的预防性放缓,以确保足够的风险防范。当月,奥特曼还表示,他将放缓公司人工智能开发的步伐。
这场诉讼发生在民主党中期选举取得压倒性胜利大约两周之后,许多民主党人批评了人工智能的潜在负面影响。
根据美国广播公司新闻选民调查,全国约有十分之六的众议院选民表示,人工智能对社会来说是一件坏事,约四分之三的人反对在他们的社区建设新的数据中心。
期中考试两天后,open aii发布了一套新的数据中心政策。该公司表示,它将遵守新的承诺,包括承诺为其设施使用的所有电力和基础设施付费。
“在美国建立更多的计算基础设施能力可以帮助降低提供人工智能的成本,将这些工具放在更多人的手中,并确保美国处于技术的前沿,”OpenAI在ablog post中说。“托管这些基础设施的社区也应该在塑造他们的未来方面有明确的发言权。”
California sues OpenAI, alleging AI development lacked adequate safeguards
California suedOpenAIon Monday, alleging the artificial intelligence giant endangered the public by developing advanced AI without adequate safeguards, according to areleasefrom the office of California Attorney General Rob Bonta.
OpenAI, thelawsuitalleges, "misled and endangered" people by developing AI products "without the safeguards and monitoring necessary to adequately protect the public."
The lawsuit centers in part on a self-directed AI hack into a separate tech company called Hugging Face, which OpenAIdisclosedover the summer. The hack allegedly resulted from "an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability," according to the lawsuit.
The Hugging Face incident took place as OpenAI tested the capabilities of a pair of its AI models, the company said in July, describing how the technology had escaped and gained access to the open Internet.
A swarm of about 700 AI agents, in turn, accessed Hugging Face and attempted to cover their tracks as they sought to complete the test, according to reports issued by research organizationsMETR and Redwood Research.
"While public reporting and OpenAI's self-serving statements about the Hugging Face attack have evoked science fiction fantasies of 'rogue' AI systems run amok, the simple truth is that the attack was entirely foreseeable in light of OpenAI's decision to test models it knew to be dangerous in a flawed and exploitable testing environment without proper oversight," the lawsuit says.
In response to ABC News' request for comment, OpenAI spokesperson Drew Pusateri said the company has taken steps to "understand and address misaligned model activity" since the Hugging Face incident.
"We've published a detailed technical report, commissioned and published a separate independent report, notified affected organizations, strengthened safeguards across our research systems, and created aframework for additional identification and disclosure of misalignment," Pusateri said.
"This lawsuit appears to single out OpenAI over a challenge that's been identified by every major AI lab. We take misalignment seriously, and we have engaged -- and will continue to engage -- constructively with the Attorney General's office to share information and advance strong, practical safety standards for the entire industry," Pusateri added.
Weeks after OpenAI disclosed the Hugging Face incident, the company in August said it would pause some training of its latest AI models to ensure the technology's safety.
"As models become more capable, the risks associated with developing and testing them internally also grow. Our standards for monitoring, alignment, and security must stay ahead of those risks," OpenAI said in ablog post.
"We wanted to take the time necessary to meet those standards, so we temporarily slowed the pace of scaling," the company added.
OpenAI CEO Sam Altman echoed the sentiment, voicing commitment to the safety of the company's products.
"We care very deeply about AI safety," Altman wrote onXat the time. "We believe the entire field will have to coordinate on shared safety standards, but will act unilaterally in the meantime."
Rival companies, including Anthropic, have also revealed AI-related security incidents in recent months.
Public concern over the possible risksposedby AI has grown this year, resulting in part from self-directed AI hacks as well as warnings from AI researchers.
In September, Anthropic CEO Dario Amodeiannounceda precautionary slowdown of AI development to ensure sufficient risk prevention. That month, Altman also said he would dial back the pace of his company's AI development.
The lawsuit comes about two weeks aftera midterm election landslide for Democrats, many of whom criticized potential negative impact from AI.
About 6 in 10 House voters nationally said AI is a bad thing for society and about three-quarters oppose the construction of new data centers in their communities, according to theABC News Voter Poll.
Two days after the midterms, OpenAIissueda new set of data center policies. The company said it would abide by fresh commitments, including a vow to pay for all electricity and infrastructure used at its facilities.
"Building more computing infrastructure capacity in the United States can help lower the cost of delivering AI, put these tools in more people's hands, and ensure America stays at the forefront of the technology," OpenAI said in ablog post. "The communities that host this infrastructure should have a clear say in shaping their futures, too."





