DiscoverLessWrong (30+ Karma)“What SB 53, California’s new AI law, does” by tlevin
“What SB 53, California’s new AI law, does” by tlevin

“What SB 53, California’s new AI law, does” by tlevin

Update: 2025-09-30
Share

Description

California Governor Gavin Newsom signed SB 53 on September 29. I think it's a pretty great step, though I certainly hope future legislation builds on it.

I wrote up my understanding of what the text actually does; I welcome any corrections (and certainly further analysis for what this all means for AI safety)!

Very short summary

The law requires major AI companies to:

  • Publish a frontier AI framework describing how the developer “approaches” assessing and mitigating catastrophic risks, defined as risks of death/serious injury to >50 people or >$1B in damage from a single incident related to CBRN uplift, autonomous crime, or loss of control, and keep the published version of the framework up to date.
  • Publish model cards summarizing the assessments of catastrophic risks from the model, the role of third parties in those assessments, and how the frontier AI framework was implemented.
  • Report to California's Office of Emergency [...]

---

Outline:

(00:32 ) Very short summary

(02:22 ) Longer summary

(02:25 ) What the bill requires of large frontier developers

(07:38 ) Other notes about the bill

---


First published:

September 29th, 2025



Source:

https://www.lesswrong.com/posts/z5wJMvTafuvBgHnEj/what-sb-53-california-s-new-ai-law-does


---


Narrated by TYPE III AUDIO.

Comments 
loading
In Channel
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

“What SB 53, California’s new AI law, does” by tlevin

“What SB 53, California’s new AI law, does” by tlevin