California proposes AI kill switch

Governor Gavin Newsom signed an executive order Friday to create a kill switch for frontier AI models after recent constraint breaches by major companies.

Two-month expert panel timeline

A national panel of experts will have two months to develop AI safety recommendations for Newsom's office to incorporate into state law.

Independent audits and verification

The executive order requires embedding independent verification organizations in AI labs for periodic audits and evaluations of model behavior.

Disclosure of loss-of-control incidents

AI companies must file risk assessments and report loss-of-control incidents to third-party organizations, similar to the recent Hugging Face incident.

Anthropic CEO backs third-party access

Anthropic's Dario Amodei proposed a three-step plan where AI companies grant ongoing employee-like access to third-party safety evaluators.

Newsom's urgency on AI oversight

The governor emphasized acting with urgent velocity before it's too late, saying the stakes are too high to wait or delay action on AI safety.

“We're going to speed up our work on substantial and responsible AI oversight before it's too late.”