Anthropic, OpenAI face scrutiny over independent AI evaluations

Anthropic and OpenAI have sought significant control over what outside evaluators can publish, concerned that findings could reveal trade secrets, according to two people familiar with the discussions.Anthropic CEO Dario Amodei said last month that external evaluators should have the right to publish key findings "without editorial control." OpenAI agreed days later, saying assessors should have "editorial independence."The AI companies are worried that evaluator staff working inside the companies' walls as part of so-called embedded evaluation could take proprietary information to rivals, according to the people, who declined to be named as the matter was private.Measures under discussion to prevent…

First reported by ET CIO. This page is a short excerpt; the full text is theirs.