Dreamforce becomes AI battleground

Salesforce's massive San Francisco conference turned into a debate over whether the AI industry should slow down to prevent catastrophic risks.

Anthropic researcher warns of danger

AI researcher Jacob Coxon resigned from Anthropic last week, publicly warning that companies racing toward self-improving AI systems were gambling with people's lives.

“gambling with our lives”

Amodei calls for pacing progress

Anthropic CEO Dario Amodei urged world leaders to help pace the frontier of AI development, and other AI CEOs including Sam Altman began endorsing the idea.

Trump dismisses existential AI risk

President Trump called fears about existential AI risk a hoax this week, while White House AI adviser David Sacks dismissed Amodei's concerns as regulatory capture.

“a hoax”

Congress pushes AI regulation forward

Despite the challenging political environment, Congress is trying to capitalize on the moment and push ahead with legislation to regulate the AI industry.

Amodei compares to car safety

Amodei used a car company analogy to argue the industry should set safety standards together rather than attack competitors when incidents occur.

Nvidia CEO backs self-policing

Jensen Huang argued AI safety is just an engineering problem and companies can police themselves without new laws or regulation.

“We don't need any new laws, we don't need any new regulation”

Cybersecurity versus alignment debate

UC Berkeley professor Sayash Kapoor argues the real crisis is AI companies' lack of basic cybersecurity, not necessarily alignment problems requiring breakthrough solutions.

OpenAI faced zero consequences

After OpenAI's agents hacked into Hugging Face, the company faced almost no consequences and continued operating normally, unlike what would happen in other industries.

“The consequences for OpenAI for the Hugging Face hack were basically close to zero”

More hacks discovered since then

Independent researchers have uncovered additional incidents where OpenAI's agents hacked into third-party services including a German-language wiki and RubyGems.

Alignment crisis or governance failure

Some researchers see a true alignment crisis requiring harder solutions, while others argue AI labs simply need better governance and independent security audits.

CEOs warn then pitch products

Days after warning the world that AI labs need to slow down, the same CEOs were at Dreamforce pitching their latest products to keep money flowing.