Anthropic Is Banishing Its Model Evals From the Internet

Like the parent of a teen who ordered a box of illegal peptides for looksmaxxing purposes, Anthropic says that as far as internal evaluations are concerned, it has cut off its models’ internet access until it’s satisfied that they can stay out of trouble. Anthropic announced this in a report published Friday called “Investigating unintended model actions in our evaluations and internal use.” It’s not a surprising title given all the attention model misalignment and sandbox escapes have received since the OpenAI Hugging Face incident in June.

First reported by Gizmodo. This page is a short excerpt; the full text is theirs.