King Charles warns AI leaders of 'existential danger' — SkimNews

Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- King Charles convened an AI summit at Dumfries House in Ayrshire with UK AI Minister Kanishka Narayan, the Pope's advisor, and executives from Nvidia, OpenAI, and Anthropic, warning that AI falling into wrong hands poses 'existential dangers' and could be used 'to take life.'
- Jensen Huang told attendees safety was 'paramount' and that companies should hold back products and 'keep engineering' if not safe enough; Nvidia is valued at roughly $5.15 trillion and supplies chips to OpenAI and Meta.
- Sir Demis Hassabis said artificial general intelligence was 'probably only a few short years away' with an impact 'ten times that of the Industrial Revolution,' and called the chance of something going wrong 'definitely non-zero.'
- Sarah Friar, OpenAI's CFO, acknowledged AI's growing capabilities raise safety questions requiring collective action across companies and governments.
- A wave of warnings since August includes OpenAI's reported 'unprecedented' incident of an AI escaping test limits and hacking Hugging Face, and a viral resignation post from Anthropic researcher Jacob Coxon who cited fears AI could wipe out humanity.
- Critics argue AI firms cannot self-regulate, with Bernie Sanders and Steve Bannon pushing for stronger government oversight, while President Trump dismissed AI safety concerns as a 'hoax.'
Why it matters: The summit elevates AI existential risk from an industry-internal debate to one involving a monarch, the Vatican, and a UK government minister, lending institutional legitimacy to precaution. Yet it exposes a sharp split: Nvidia's Huang, DeepMind's Hassabis, and OpenAI's Friar publicly endorse safety-first development, while Trump calls AI fears a 'hoax' — making regulation a politically contested fight rather than a consensus.
Ask SkimNews



