Anthropic Proposes AI Bill to Block Models Risking 50+ Deaths — SkimNews
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- Anthropic has drafted a proposed AI safety bill that would enable a halt to an AI model’s release if it poses a foreseeable, imminent risk of killing over 50 people or causing over $1 billion in property damage.
- Anthropic tied catastrophic risk to specific scenarios: the creation or release of a biological weapon, a model evading developer controls, or a major cyberattack.
- Independent evaluators registered with the U.S. Commerce Department would assess models for catastrophic risk, with labs allowed to pay them so long as compensation isn’t tied to the outcome.
- The Commerce Department would have to seek a court order from a Washington, D.C., judge to block a model’s release, as no federal agency could unilaterally stop distribution under the draft legislation.
- Anthropic confirmed the draft bill aligns with its Advanced AI Framework, which it has advocated for with lawmakers since June, though it has not yet responded to direct media inquiries.
Why it matters: Anthropic’s proposal sets a concrete threshold for intervention—50 lives or $1B in damage—giving regulators a measurable standard, while removing unilateral federal power in favor of judicial oversight. This shifts the debate from voluntary self-regulation to codified risk triggers, directly challenging industry resistance to binding rules.
Ask SkimNews
