King Charles warns AI leaders of 'existential dangers' — SkimNews
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- King Charles convened the AI summit at Dumfries House in Ayrshire, telling executives there is 'urgency' in addressing the 'existential dangers' of AI and that the task is to keep technology 'firmly in the service of humanity'.
- Nvidia CEO Jensen Huang said safety is 'paramount' and companies should hold back and 'keep engineering' if a product isn't safe enough, while championing open models so 'people and countries are not left behind'; Nvidia is the world's most valuable company at roughly $5.15tn.
- DeepMind co-founder Demis Hassabis warned artificial general intelligence is 'probably only a few short years away' with an impact 'ten times that of the Industrial Revolution,' calling the chance of something going wrong 'definitely non-zero.'
- OpenAI CFO Sarah Friar said no single company or government can address AI safety alone, thanking the King for convening the discussion at a moment when industry concern has escalated.
- The summit, which included UK AI Minister Kanishka Narayan and the Pope's advisor, aimed to develop a 'shared set of principles' to guide AI's future application.
- The meeting follows a September resignation post from Anthropic researcher Jacob Coxon that went viral on extinction fears, colleague Evan Hubinger putting the extinction chance above 10%, and CEO Jack Clark suggesting a possible 'kill switch' for humanity.
Why it matters: With the UK's monarch personally convening Nvidia, OpenAI and DeepMind leaders and Hassabis putting AGI 'a few short years away,' the gathering frames industry self-governance — a 'shared set of principles' — as the near-term answer to a risk some insiders rate above 10% for human extinction, even as figures from Bernie Sanders to Steve Bannon push for binding government oversight instead.
Ask SkimNews
