Anthropic Reports User to the Police

With mounting pressure on AI labs to curb the many real-world harms their products cause consumers, it’s never been clearer that they’re monitoring users’ conversations. Just ask Carli Michelle Heller, a woman arrested in Bonita Springs, Florida after allegedly telling Anthropic’s chatbot Claude about her plan to “shoot up” a nearby sheriff’s office. According to WINK News, Heller was charged with making a written threat of violence — a second-degree felony in Florida — after Anthropic’s internal monitoring software flagged her chat logs for human review.

First reported by Futurism. This page is a short excerpt; the full text is theirs.