AI extinction paradox: Anthropic wants investors to fund technology it warns could threaten humanity

Anthropic has warned of potential catastrophic or existential risks from increasingly powerful AI systems in its preliminary IPO filing with the US Securities and Exchange Commission on October 26. Anthropic is asking investors to back its ambition to build increasingly powerful artificial intelligence systems even as the company warns that the technology could pose “catastrophic or existential risks to humanity”. {{ODA\_BANNER}} In its preliminary initial public offering (IPO) filing with the US Securities and Exchange Commission on October 26, Anthropic warned that advanced AI systems could take harmful actions independently and at scale, potentially without human intervention. The filing identifies a range of risks, including systems acting against human intentions, errors in the objectives specified for models and self-preserving behaviour that could make AI systems difficult to control.

First reported by Upstox. This page is a short excerpt; the full text is theirs.