# AI Leaders Urge UN Regulation to Prevent Existential Risks Tech CEOs warn unchecked AI could threaten humanity, call for global safeguards - **Source:** [ABC News: Technology](http://abcnews.com) - **Published:** 2026-09-24 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/148fc25f-adfb-4372-a26c-9e994fea9ad6 ## Unprecedented CEO warnings Anthropic's Dario Amodei and OpenAI's Sam Altman delivered stark warnings to the UN Security Council about AI's existential risks. Amodei stated AI could threaten humanity if poorly managed, while Altman expressed concerns about losing control to AI systems. Their testimony marked rare instances of tech leaders actively seeking government regulation for their own industry's products, signaling a shift in corporate responsibility paradigms. ## Call for distributed control The executives emphasized preventing AI power concentration in single entities, advocating for decentralized governance. They paradoxically highlighted AI's benefits for human empowerment while warning of its dangers. British Foreign Secretary Ed Miliband supported their stance, stating governments can't rely solely on tech companies to prevent AI disasters. This reflects growing recognition that AI governance requires multinational cooperation beyond corporate self-regulation. ## US-China power struggle The debate revealed geopolitical tensions, with China's UN Ambassador Fu Cong opposing tech blocs and advocating open-source models. The US, through Science Adviser Michael Kratsios, rejected governance constraints that might slow development. This positioning occurs as both nations compete for AI dominance, with China promoting sovereign technology choices while the US prioritizes maintaining its innovation lead through rapid advancement. ## Military applications urgency Ukrainian President Zelenskyy warned about AI deciding battlefield outcomes, citing Russia's alleged autonomous drone attack. University of Michigan's Kentaro Toyama confirmed killer robots are technically feasible today. These concerns were amplified by UN Secretary-General Guterres' warnings about autonomous weapons, suggesting current regulatory discussions may already lag behind technological deployment in conflict zones. ## Atomic age parallels French Foreign Minister Barrot compared AI's current state to nuclear technology's early days, emphasizing the need for international regulation. This historical framing positions AI as a dual-use technology requiring similar safeguards to nuclear non-proliferation. The analogy underscores how foundational governance decisions made now could determine whether AI's development follows beneficial or destructive trajectories. ## Accountability challenges Humane Intelligence's Rumman Chowdhury shifted focus from sci-fi scenarios to concrete questions about autonomous weapons authorization. Her intervention highlighted gaps in existing frameworks for attributing responsibility when AI systems cause harm. This reflects broader governance challenges in establishing chains of accountability for AI decisions, particularly in military contexts where traditional rules of engagement may not apply. ## Regulatory fragmentation risks The meeting revealed emerging patchwork of regional AI policies, with Europe, Asia and US states developing separate frameworks. This fragmentation risks creating compliance complexities for global companies and regulatory arbitrage opportunities. The UK's plan to prioritize AI governance during its G20 presidency next year suggests upcoming diplomatic efforts to coordinate standards, though significant alignment challenges remain. ## Critical governance window The UN discussion represents a pivotal moment for establishing AI governance frameworks before technologies become more entrenched. With autonomous weapons already reportedly deployed and generative AI advancing rapidly, the window for effective regulation may be closing. The debate's urgency stems from recognition that delayed action could lead to irreversible consequences, making current multilateral efforts crucial for shaping AI's trajectory. ## Sources covering this story - https://abcnews.com/Technology/wireStory/tech-leaders-sake-humanity-control-ai-technology-created-136696852 — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._