From The Verge · Stevie Bonifield · · 1m 30s
AI researchers warn superintelligence poses extinction risk
Researchers from OpenAI, Google and Anthropic released videos claiming advanced AI could be catastrophically dangerous, with some estimating human extinction odds as high as a coin flip.
In brief
Researchers from OpenAI, Google and Anthropic released videos claiming advanced AI could be catastrophically dangerous, with some estimating human extinction odds as high as a coin flip. AI researchers at major labs released videos warning that superintelligent AI poses severe extinction risks, with some estimating…
Researchers warn of extinction risk

Geoffrey Irving, a former OpenAI and Google DeepMind employee, said the chance of human extinction from AI is about a coin flip. A dozen interviews with current and former researchers at major labs were collected by Palisade Research.
“The chance of human extinction is about a coin flip, in my view”
Google researcher estimates ten percent extinction chance
Neel Nanda, a Google DeepMind research scientist, said there is at least a ten percent chance that AI causes human extinction, calling that probability ridiculously high.
“at least a 10 percent chance that it causes human extinction, and that is ridiculously high”
Former OpenAI researcher calls it god-like and uncontrollable
Daniel Kokotajlo, a former OpenAI researcher, said superintelligent AI would be god-like powerful and that we do not know how to control them. He warned this is exactly as dangerous as it sounds.
“This is exactly as dangerous as it sounds and must not be allowed to happen”
Researchers address skepticism and motivation

Google's Mary Phuong acknowledged suspicion is warranted because she is paid by the lab. Neel Nanda said he would quit if he did not believe his work reduced existential risks, noting companies will not stop making these systems if he leaves.
“I think you absolutely should be suspicious of what I'm saying because I am being paid by the lab”
Videos launched on frominside.ai platform
Palisade Research, a nonprofit studying AI capabilities and motivations, collected and launched the interviews on frominside.ai. The site groups segments from multiple researchers discussing similar topics including whether warnings are hype or marketing.
What matters most
AI researchers at major labs released videos warning that superintelligent AI poses severe extinction risks, with some estimating extinction probability at fifty percent or higher.


