From Fastcompany · · 2m
We're already living in the AGI era, and we're unprepared
Kevin Roose on why AI researchers fear the technology they're racing to build, and why the finish line keeps moving.
In brief
Kevin Roose on why AI researchers fear the technology they're racing to build, and why the finish line keeps moving. AI researchers are already living in the early years of artificial general intelligence, but institutions remain dangerously unprepared for what comes next. Originally reported by Fastcompany.
The paradox at the heart of AGI
We're already living in the early, imperfect years of artificial general intelligence. Our institutions are dangerously unprepared for what comes next.
Fear drives the builders
Many key figures in the AI race got into the field because they were terrified of what superintelligent machines might do to humanity.
Three tribes of AI researchers
Scientists see AGI as an intellectual challenge to cure disease. Seekers view it as an evolutionary turning point for humanity.
The survivalists' logic
Survivalists believe if AGI isn't built by the good guys, the bad guys will build it instead, so they must accelerate development.
The acceleration trap
Everyone is trying to get there first. They all conclude the only way to move forward responsibly is to accelerate development.
Dario Amodei's paradox
Anthropic CEO Dario Amodei left OpenAI partly out of concern it was moving too fast, then built a competitor that had to move just as fast.
Living inside the paradox
Amodei and many others in the AGI race are trapped inside the paradox of fearing the technology while racing to build it.
About Kevin Roose
Roose is an award-winning technology journalist and bestselling author. He spent a decade as a technology columnist for The New York Times.
Hard Fork and Machine Gods
Roose co-created and cohosted Hard Fork, a popular podcast at The New York Times. He now cohosts Machine Gods, an AI-focused podcast with NPR.
The AGI Chronicles book
Roose's new book is The AGI Chronicles: The Inside Story of the Race to Create an Artificial Superintelligence.
Cofounder of Machine Gods Media
Roose is cofounder of Machine Gods Media, which produces AI-focused content and podcasts in partnership with major outlets.
The bottom line
AI researchers are already living in the early years of artificial general intelligence, but institutions remain dangerously unprepared for what comes next.
