Rogue AI Must Threaten 50 Lives Before Being Shut Down, Anthropic Suggests

Anthropic is pushing legislation that would only allow the US government to shut down a rogue AI model when at least 50 people are at risk of imminent serious harm or death. The AI firm has been quietly lobbying congress to adopt its draft bill, a copy of which was obtained by Politico. Under the bill, a state-led “blocking order” can also be triggered if there is a risk of an AI model causing at least $1bn (£750m) in damage to property. The rules laid out in the draft would prevent US states from enforcing tougher safety laws and make it harder for courts to put the brakes on dangerous AI systems. They set a high threshold for federal intervention in the case of potential “catastrophic harm”.

First reported by Novara Media. This page is a short excerpt; the full text is theirs.