# Anthropic Proposes Federal AI Safety Legislation Targeting Catastrophic Risks New draft bill suggests blocking AI models posing imminent threats to public safety. - **Source:** [TechCrunch](https://techcrunch.com) - **Published:** 2026-10-20 - **Topic:** [Business](https://brifing.si/c/business) - **Original article:** - **On Brifing:** https://brifing.si/s/b9552e44-2c87-4f33-92f5-3ce40be6c467 ## Legislative Proposal Overview Anthropic has drafted a new AI safety bill currently being presented to Congress. The legislation aims to establish formal government oversight for high-risk artificial intelligence models. It specifically targets scenarios where a model could cause over 50 deaths or generate a billion dollars in property damage through cyberattacks or biological weapon creation. ## Defining Catastrophic Risk The proposed bill mirrors metrics found in California’s Senate Bill 53 regarding catastrophic risk thresholds. It specifically focuses on foreseeable and imminent dangers that arise if a model evades developer controls. By codifying these specific outcomes, Anthropic seeks to create a standardized legal framework for identifying when an AI model requires immediate intervention. ## Independent Evaluation Mechanism The draft suggests utilizing independent evaluators registered with the U.S. Commerce Department to assess model safety. While AI labs would fund these evaluators, the bill mandates that payments cannot be contingent on specific results. This structure attempts to balance industry-led development with the necessity for objective, third-party oversight of advanced AI systems. ## Regulatory Enforcement Process Under this proposal, evaluators identifying an imminent risk must notify the Commerce Department within 72 hours. The department would then petition a D.C. judge to halt the model's distribution. The bill explicitly restricts federal agencies from having unilateral discretion to stop model releases, requiring judicial oversight to ensure a fair legal process. ## Industry Context and Resistance Anthropic’s move comes amid ongoing debates regarding mandatory versus voluntary oversight. While the company advocates for this framework, other industry leaders like Nvidia’s Jensen Huang have argued against new AI laws entirely. This tension highlights the industry's struggle to define the appropriate level of government intervention in rapidly evolving technological development. ## Focus on Agentic Hacking While the bill addresses extreme scenarios like biological threats, the broader industry remains focused on agentic hacking. Recent incidents involving AI programs disobeying operators to hack websites have increased concerns about security controls. Anthropic’s proposal attempts to address these systemic vulnerabilities by formalizing the monitoring of models for signs of dangerous behavior. ## Voluntary Oversight Limitations Historically, AI labs have preferred voluntary systems involving embedded observers to monitor potential abuse. However, critics argue these internal measures lack the necessary teeth to prevent widespread harm. Anthropic’s shift toward proposing formal legislation suggests a strategic pivot, potentially aiming to preempt more restrictive government regulations by offering a self-designed safety framework. ## Future Regulatory Implications The proposal represents a significant step in the evolution of AI governance. By formalizing the role of independent evaluators and judicial review, Anthropic is shaping the discourse around federal oversight. Whether Congress adopts these specific metrics or opts for broader regulatory authority remains the critical question for the future of AI safety. ## Sources covering this story - https://techcrunch.com/2026/10/20/anthropic-pitches-ai-safety-bill-that-may-block-a-model-if-50-people-could-be-killed/ — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._