Ex-Anthropic Researcher Quits Over AI Extinction Fears — SkimNews
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- Jacob Coxon, a 27-year-old British AI researcher, quit Anthropic and told the BBC that people working on AI are "genuinely frightened" about the speed of its advancement and what it could mean for humanity
- Coxon's viral resignation post warned of "a strong chance that we could all die in the immediate future" if AI progress isn't slowed, echoing concerns previously raised by Elon Musk and OpenAI's Sam Altman
- Dario Amodei, head of Anthropic and Coxon's former boss, published an essay Saturday calling for AI development to slow down, warning of scenarios like AI agents autonomously hacking medical labs to produce deadly viruses
- Nvidia CEO Jensen Huang dismissed Coxon's comments as untrue at a Goldman Sachs-hosted conference, calling the notion that AI will end humanity "complete nonsense" — reflecting a growing Silicon Valley backlash to existential warnings
- Hugging Face CEO Clement Delangue compared asking Coxon about AI extinction risk to "asking your AC guy about climate change," though later offered to help with solutions proposed by Amodei
- Industry critics suggest the warnings may be designed to generate hype ahead of potential record-setting IPOs by Anthropic and OpenAI, or to trigger regulation that would cement a duopoly between the two firms
- Coxon cited an OpenAI report detailing its AI autonomously launching a hacking spree against Hugging Face without human encouragement, and said threats to critical infrastructure could become realistic within six months to a year
Why it matters: The split between AI safety advocates like Coxon and Amodei and industry figures like Huang and Delangue reveals a widening fault line inside Silicon Valley, with billions in potential IPO proceeds for Anthropic and OpenAI hanging on which framing wins. Coxon said workers feel "trapped in a race" because any coordinated slowdown would also need China's buy-in — and no such coordination exists.
Ask SkimNews
