Anthropic gives METR inside access to audit its AI models and safety practices

Anthropic has given a team from the nonprofit METR inside access to review its AI models and safety practices, the company announced. Six METR staffers received company hardware, office space, and access to internal tools, which Anthropic says puts them roughly on par with its own risk teams. Customer data, information covered by attorney-client privilege, and details about the model architecture remain off-limits. METR will publish its findings independently. Anthropic says it can ask for redactions in certain predefined categories, but METR is free to say publicly whether it thinks those redactions were justified. Anthropic argues that not all safety-relevant information can be made public, either because it could help attackers or because it's commercially sensitive. The METR deal goes further than what the company has offered other outside reviewers.

First reported by The Decoder. This page is a short excerpt; the full text is theirs.