Anthropic tells Governor Gavin Newsom courts should be able to block risky AI models

Anthropic has told California Governor Gavin Newsom that the state should be able to ask a court to block AI models that pose a serious risk. The AI company made the case in a letter first reported by Politico. The letter, dated 15 October, responds to an executive order Governor Gavin Newsom signed in September. The order set up a working group to suggest, within two months, how to make California’s AI safety laws stronger. One question is whether developers must be able to switch their models off. An Anthropic spokesperson confirmed the letter was genuine, but Newsom’s office did not immediately respond. Under its proposal, independent evaluators would report risks to California’s attorney general.

Also reported by The Economic Times, The Sun Herald, Reuters, Politico.

First reported by The Next Web. This page is a short excerpt; the full text is theirs.