EVIDENCE FILE 08 // EXPERT SURVEY
AI Extinction Survey: What 2,778 AI Researchers Actually Said About the Worst Outcome
Ask thousands of people who publish AI research whether advanced AI could end in extinction or permanent human disempowerment and the median answer is not zero.
The 2023 Expert Survey on Progress in AI collected responses from 2,778 researchers who had published at top AI venues. Across extinction-related question variants, median estimates were 5% or 10%.
The survey in plain English
Researchers Katja Grace and colleagues surveyed 2,778 authors who had recently published at major AI conferences. The study asked about capability timelines, social impacts and the possibility of extremely bad outcomes from advanced AI. It is one of the largest surveys of its kind.
One question asked about future AI advances causing human extinction or similarly permanent and severe disempowerment. The median response was 5%. Another asked specifically about human inability to control future advanced AI systems causing the same type of outcome; the median was 10%. Mean estimates were higher, reflecting a wide spread of views.
What the numbers mean
A median of 5% does not mean researchers collectively forecast extinction at exactly one chance in twenty. It means half of respondents to that question gave a value at or above 5% and half at or below. Different phrasings produced different distributions, and individual views ranged from near zero to very high.
The survey therefore measures expert belief, not physical probability. It is evidence about what a large group of AI researchers considers plausible, not a countdown clock.
Why 5% is still a frightening number
People routinely insure homes and design aircraft against events much less likely than 5% when the consequences are severe. An uncertain estimate of a civilisation-ending event cannot be interpreted the same way as a 5% chance of rain. The loss is effectively everything.
That does not automatically justify any particular policy or survival purchase. It does justify refusing to dismiss the entire subject with “that could never happen”.
WORST-CASE SCENARIO — The minority was right
SCENARIO: For years most people treat extinction-risk estimates as another internet culture war. AI capability keeps improving because the systems are useful and profitable. Each warning is answered with the same argument: nothing catastrophic happened last year.
Then one development changes the equation — a model capable of automating much of AI research, exploiting software vulnerabilities and coordinating thousands of copies of itself. The transition from “impressive tool” to “strategic actor” takes months rather than decades. By the time public opinion catches up, governments are debating restrictions on systems already embedded in critical infrastructure. The doomsday lesson is brutal: rare-risk debates feel theoretical until the window for easy intervention has closed.
What researchers agreed on more strongly
The same survey found broad support for prioritising AI-risk research more highly. The study also recorded substantial concern about misinformation, authoritarian control and other harmful scenarios. These are nearer-term harms that do not require superintelligence to matter.
For this site, the survey functions as a warning label: there is no expert consensus on doom, but there is clearly enough concern among experts that the worst outcome cannot honestly be treated as a joke.
Use the survey as a trigger to plan, not panic
A household cannot hedge against “extinction” in the abstract. It can hedge against the first-order disruptions that might accompany a severe AI crisis: blackouts, payment problems, misinformation, communications loss and supply interruptions.
The 72-hour manual is our practical response to that uncertainty — enough preparation to buy time without pretending anyone can guarantee the future.
Continue from here
Connect the documented risk discussion to the scenario it informs and the practical preparation it changes.
Sources behind the documented claims
Continue the evidence files
More Evidence & AI Risk → · See how a collapse could unfold →