Anthropic Grants METR Unprecedented Insider Access to Audit AI Safety Risks

Anthropic is opening its doors to outside scrutiny in a way no frontier AI lab has before. The company has struck a landmark agreement giving the nonprofit AI evaluation organization METR unprecedented, employee-level access to evaluate its models, risks, and safety practices. The arrangement goes far beyond the typical pre-deployment API access granted to external testers. METR researchers will be embedded much like internal staff, with deep visibility into Anthropic's development pipeline, safety testing, and deployment decisions. According to details shared by both organizations, METR will get access to pre-deployment models, internal evaluation tools and infrastructure, and insight into Anthropic's Responsible Scaling Policy in action. That includes the ability to probe models for dangerous capabilities, such as cyber-offense, deception, autonomous replication, and assistance with weapons of mass destruction.

Also reported by Reuters, Financial Times, NewsCord.

First reported by AndroGuider. This page is a short excerpt; the full text is theirs.