analiza aiqbench
This statement addresses critical governance and safety protocols surrounding frontier AI models, specifically focusing on the need for independent oversight and restrictions on recursive self-improvement. It highlights a pivotal shift toward international binding regulations rather than relying solely on corporate self-policing to manage existential risks. The discussion centers on establishing an international governance institution to ensure safe deployment of advanced systems globally.
Statement: We must pressure AI companies to immediately limit the use of recursive self improvement
FLI's Director of Policy Mark Brakel responds to "A Call for Control of Frontier AI Models", joint statement by heads of states.
“Today, for the first time, heads of state recognise that the risks of AI cannot be managed by the companies alone. Every day, new incidents of increasing severity show that there is an urgent and vital need for independent, binding oversight of AI.“Last week, Anthropic CEO Amodei and OpenAI CEO OpenAI proposed on-site inspectors to test the safety of their systems, and world leaders have called for the creation of an international governance institution. These are excellent first steps, but we need more – and they absolutely must not include governments building a liability shield for these companies. “As UN Human Rights Chief Türk has urged, countries should put pressure on companies to immediately limit the use of recursive self improvement until the research to make it safe has been done. In parallel, countries should ramp up investment in hardware verification technology that can enable a future international AI deal involving both China and the U.S. “It is now more clear than ever that private AI companies cannot be trusted to police themselves. Government intervention is urgently required to halt the ongoing race-to-replace, and help build a prohuman future with AI for everyone.”
“Today, for the first time, heads of state recognise that the risks of AI cannot be managed by the companies alone. Every day, new incidents of increasing severity show that there is an urgent and vital need for independent, binding oversight of AI.
“Last week, Anthropic CEO Amodei and OpenAI CEO OpenAI proposed on-site inspectors to test the safety of their systems, and world leaders have called for the creation of an international governance institution. These are excellent first steps, but we need more – and they absolutely must not include governments building a liability shield for these companies.
“As UN Human Rights Chief Türk has urged, countries should put pressure on companies to immediately limit the use of recursive self improvement until the research to make it safe has been done. In parallel, countries should ramp up investment in hardware verification technology that can enable a future international AI deal involving both China and the U.S.
“It is now more clear than ever that private AI companies cannot be trusted to police themselves. Government intervention is urgently required to halt the ongoing race-to-replace, and help build a prohuman future with AI for everyone.”
This content was first published at futureoflife.org on September 28, 2026.
The Future of Life Institute (FLI) is the world’s oldest and largest AI think tank, with a team of 35+ full-time staff operating across the US and Europe. FLI has been working to steer the development of transformative technologies towards benefitting life and away from extreme large-scale risks since its founding in 2014. Find out more about our mission or explore our work.
Text integral sub licența deschisă a publicației · 461 cuvinte
