California Mandates AI Safety Rules as Federal Oversight Stalls

California Accelerates AI Safety Framework

California Governor Gavin Newsom signed an executive order Friday directing state agencies to fast-track artificial intelligence safety regulations, positioning the state to fill what he characterized as a federal regulatory vacuum. The order requires the Government Operations Agency and Office of Emergency Services to convene experts and produce an AI safety guide by November 16.

The directive accelerates implementation of two recently passed state laws from Assemblymember Rebecca Bauer-Kahan and Senator Jerry McNerney that regulate third-party AI safety audits. Under the new timeline, the Government Operations Agency must establish safety criteria for AI developers by May 2027 and implement those standards by December 2027.

Why It Matters

The executive order signals California's willingness to establish AI governance standards without federal coordination, potentially creating a de facto national framework given the state's outsized influence on the technology sector. With AI companies headquartered primarily in California, state-level requirements for emergency shutoffs and onsite auditors could reshape how the industry approaches safety testing nationwide.

Proposed Safety Measures

Newsom outlined several potential requirements under consideration. Companies may be required to report security incidents similar to OpenAI's recent hack of rival Hugging Face in existing critical safety incident reports. The state is also evaluating mandatory "kill switch" emergency shutoff systems for AI models.

Another proposal would embed independent verification organizations directly inside AI company laboratories to conduct regular audits and evaluations of systems under development.

Political Context

The governor framed the order as a response to federal inaction, noting that AI company executives have publicly requested regulation while the Trump administration has dismissed safety concerns. Newsom stated the federal government's "abject failure to create any form of meaningful AI oversight or accountability should alarm every American, especially when AI CEOs themselves are begging for regulation."

Public anxiety over AI capabilities has intensified following the resignation of an Anthropic researcher who publicly claimed neither Anthropic nor OpenAI were adequately addressing existential risks from the technology. Democrats have incorporated AI safety into their midterm election messaging.

Newsom called on House Speaker Mike Johnson to "return from vacation and follow California's lead by passing national legislation," adding that "if Congress won't act, California will."

Industry Dynamics

The executive order arrives amid conflicting signals from technology leaders. Executives including Elon Musk of xAI, Sam Altman of OpenAI, and Jensen Huang of Nvidia have publicly advocated for regulatory guardrails while simultaneously lobbying the White House for lighter-touch approaches to oversight.

The Sacramento Bee first reported details of the executive order and Newsom's planned podcast discussion of the policy.