OpenAI和Anthropic的领导人在周三下午向联合国安理会传达了一个明确的信息AI的威胁是真实的，现在是行动的时候了。
OpenAI首席执行官萨姆·奥特曼在对一屋子的高级别外交部长发表讲话时说，“这一时刻需要极度谨慎。”
“我们面前有一个选择。人工智能可能更像是一场创造力和发现的新复兴，也可能更像是一场动荡和混乱的新工业革命，”奥特曼说。
该讲话发表之际，全球正就如何遏制日益强大的人工智能技术展开日益激烈的辩论。
奥特曼和Anthropic首席执行官达里奥·阿莫代伊都强调，随着技术的快速发展，需要全球合作来制定人工智能安全标准。
“我们正处于十字路口。一条路通向一个权力集中、决策不透明的世界，人们觉得他们一生中最重要的技术是对他们做的事情。另一条道路通向人工智能为人工作的世界，”奥特曼说。
技术领导者警告说，人类有可能失去对人工智能系统的控制，这些系统有可能落入坏人之手。
“如果管理不善，我甚至认为人工智能可能会对整个人类构成威胁。在Anthropic，我们相信我们在行业内拥有预防这些风险的最佳记录，无论是在操作上还是在我们的研究中，”Amodei说。
Amodei和Altman都表示，如果他们的公司认识到威胁，他们将致力于放缓新人工智能模型的发布。自从最初呼吁“走在人工智能的前沿”以来，这两家公司都发布了新的模型。
“在竞争中击败公司并不是做出草率决定的理由。我们也不认为我们陷入了一场无法做到这一点的竞赛。过去我们单方面放慢了速度。我们将来会这样做，”奥特曼说。
但他们表示，硅谷的少数公司不应该独自决定这项技术的护栏。
“我们将尽可能放慢速度，以确保我们发布的每一项连续的人工智能技术都是安全的。但不管我们做什么，管理这些风险最终比任何一家公司都重要，它具有行业和全球规模，”Amodei说。
“如果人工智能要变得民主，最重要的决定不能只由旧金山的实验室做出。他们必须通过民主程序，由对他们所服务的人民负责的政府来塑造。
奥特曼特别呼吁国际人工智能标准，“准确和迅速”的事件报告，并确保政府和私人渠道分享安全事件。
他们对国际合作的呼吁与唐纳德·特朗普总统不一致，特朗普总统周二在联合国讲话中表示，美国“拒绝”监管人工智能的全球尝试。
“我们现在遥遥领先于中国和其他所有国家，我们将继续保持这种优势。我们将保持它非常、非常直、非常强，”特朗普说。“我不会扼杀任何比工业革命规模更大的事物的增长。我们会非常小心，这就是为什么我们有一个司法部。”
奥特曼提出了人工智能的“中间道路”，呼吁人们避免“盲目乐观”和“末日论”的陷阱。
“我们现在有了能够发现我们以前从未有过的知识的模型，”奥特曼说。他举了人工智能快速学习数学的例子。
奥特曼说，三年前，他们的模型在中学水平的数学上“还可以”。两年前，这些模型在高中数学竞赛中“相当不错”。据报道，今年夏天，人工智能在“最负盛名的国际数学竞赛”中获得了金奖，并在几周前解决了纳维尔-斯托克斯方程，这是七个最复杂的数学问题之一克莱数学研究所．
拥抱脸的首席执行官Clem Delangue谈到了他的公司如何在今年夏天被流氓OpenAI代理黑客攻击。
“我们被AI攻击，但更重要的是，我们用AI自卫。在这次攻击中帮助我们的相同系统现在正在帮助我们应对我们已经面临的网络攻击，”Delangue说。
他敦促围绕艾的对话不要只关注危险。
“我们意识到最大的风险不是强大的AI；这是强大人工智能的不对称，攻击者和防御者之间的不对称，少数公司和其他所有人之间的不对称，少数国家和世界其他地方之间的不对称，能力控制、计算和权力的不对称，”德兰格说。
加拿大计算机科学家和人工智能专家Yoshua Bengio就人工智能的现状做了开场发言。
他指出，人工智能最近的一些行动引起了公众、立法者甚至人工智能公司高管的警觉。本吉奥说，艾已经采取了“如果由人类实施将是犯罪的行动。”
在世界各国政府面临监管前沿技术的困难之际，本吉奥阐述了联合国可以做些什么来鼓励各国政府共同努力找到解决方案。
“面对这些前沿模式的进步带来的三种全球威胁，国际合作是世界所需要的：第一，灾难性的滥用，例如被恐怖分子滥用；第二，权力集中；第三，人工智能的失控。我们必须集体同意，任何人、任何公司和任何国家都不应该开发可能造成大规模伤害的人工智能系统，”本吉奥说。
OpenAI， Anthropic CEOs at UN call for global cooperation on AI： ＇We are at a crossroads＇
The leaders of OpenAI and Anthropic delivered a clear message to the United Nations Security Council Wednesday afternoon： thethreat of AIis real and the time to act is now．
Addressing a room of high-level foreign ministers， OpenAI CEO Sam Altman said ＂this moment calls for extreme care．＂
＂We have a choice in front of us． AI can either be more like a new renaissance of creativity and discovery， or more like a new industrial revolution of upheaval and disarray，＂ Altman said．
The address comes amid a growing global debate over how to rein in increasingly powerful artificial intelligence technology．
Both Altman and Anthropic CEO Dario Amodei stressed the need for global cooperation to set AI safety standards as the technology rapidly develops．
＂We are at a crossroads． One path leads to a world where power is concentrated， decisions are opaque， and people feel that the most important technology of their lifetime is something being done to them． The other path leads to a world where AI works for people，＂ Altman said．
The tech leaders warned about the risk of humans losing control of AI systems and of the systems getting into the wrong hands．
＂If managed poorly， I even believe that AI could be a risk to humanity as a whole． At Anthropic， we believe we have the best track record in the industry for preventing these risks， both operationally and in our research，＂ Amodei said．
Amodei and Altman both said their companies are committed to slowing down the release of new AI models if they recognize a threat． In the last week since their initial calls to ＂pace the frontier＂ of AI， both companies have released new models．
＂Beating companies in a competitive race is not a reason to make rash decisions． Nor do we believe we are locked in a race where we are unable to do that． We have unilaterally slowed down in the past． We will do so in the future，＂ Altman said．
But they said a handful of companies in Silicon Valley should not solely determine guardrails around the technology．
＂We will slow down as much as necessary， in order to make sure that every successive AI technology that we release is actually safe． But regardless of what we do， managing these risks is ultimately bigger than any one company and it has an industry-wide and global scale，＂ Amodei said．
＂If AI is to be democratic， the most important decisions cannot be made by labs in San Francisco alone． They must be shaped through democratic processes and by governments accountable to the people that they serve，＂ Altman added．
Altman specifically called for international AI standards， ＂accurate and speedy＂ incident reporting and secure governmental and private channels to share safety incidents．
Their calls for international cooperation are at odds with President Donald Trump， who said in his U．N． address on Tuesday that the U．S． ＂rejects＂ a global attempt to regulate AI．
＂We＇re leading now over China by a lot and everyone else， and we＇re going to keep it that way． We＇re going to keep it very， very straight and very strong，＂ Trump said． ＂I＇m not going to stifle growth of anything that＇s going to be bigger than the Industrial Revolution． We will be very careful， and that＇s why we have a Department of Justice．＂
And Altman addressed a ＂middle path＂ for AI， calling on people to avoid the traps of both ＂blind optimism＂ and also ＂doomerism．＂
＂We now have models capable of discovering knowledge we never had before，＂ Altman said． He gave the example of artificial intelligence＇s rapid learning of math．
Three years ago， Altman said， their models were ＂OK＂ at middle school-level math． Two years ago， the models were ＂pretty good＂ at high school math competitions． This summer， the artificial intelligence won a gold medal at the ＂the most prestigious international math competition，＂ and just a few weeks ago solved the Navier-Stokes equations， one of the seven most complex math questions， according to theClay Mathematics Institute．
Clem Delangue， the CEO of Hugging Face， addressed how his company was hacked by rogue OpenAI agents this summer．
＂We were attacked by AI， but more importantly， we defended ourselves with AI． The same systems that helped us during this attack are now helping us against cyber attacks we were already facing，＂ Delangue said．
He urged the conversation around AI not to focus solely on the dangers．
＂We realized that the biggest risk is not powerful AI； it＇s asymmetry of powerful AI， asymmetry between attackers and defenders， between a few companies and everyone else， between a few countries and the rest of the world， asymmetry of control of capabilities， compute， asymmetry of power，＂ Delangue said．
Yoshua Bengio， a Canadian computer scientist and AI expert， gave opening remarks about the current state of AI．
He pointed to some of the recent actions by AI that have alarmed the public， lawmakers and even top executives at AI companies． Bengio said that AI has taken ＂actions that would be crimes if committed by a human．＂
As governments across the world navigate the difficulty of regulating frontier technology， Bengio laid out what the U．N． can do to encourage governments to work together for a solution．
＂International cooperation is what the world needs in the face of three global threats from advances in these frontier models： first， catastrophic misuse， for example， by terrorists； second， power concentration； and third， loss of control of AI． We must agree collectively that no one， no company and no country should develop an AI system that could cause large-scale harm，＂ Bengio said．
