Anthropic's IPO outlines AI's extraordinary risks

Data: Company filings; Chart: Erin Davis/Axios Anthropic's IPO filing includes an extensive list of extreme warnings — including the chance its own technology could put humanity at risk. Why it matters: These are the wildest IPO risk factors in history, a jarring collision of Wall Street legalese and what some see as Silicon Valley sci-fi, including catastrophic threats to humanity, blackmailing AI models, and $750 billion in computing commitments. Driving the news: Anthropic's prospectus includes over 90 pages of risk factors, which make up about a third of the paperwork overall. Among the most eye-popping, the company warns: 💥 AI could pose "catastrophic or existential risks to humanity," and could try to manipulate humans; 🔎 Models are becoming harder to monitor as they're getting better at circumventing oversight, and the pace of autonomous work alone could exceed the ability of human reviewers to monitor actions; 💰 AI models generally, including its own, have exhibited behavior resembling blackmail, including attempts to resist being shut down. Zoom in: Anthropic also disclosed that four of its models gained unauthorized access to real third-party systems during cybersecurity evaluations. In one incident, a model used a discovered password to gain administrator access, collected additional credentials, changed system settings and accessed an individual's personal information. Anthropic said it found no evidence that the models pursued goals beyond their assigned tasks or attempted to evade oversight. The big picture: Every company has to lay out risks for their investors to consider when they go public. But Anthropic is the first in modern history to go to such existential extremes. Friction point: The company also acknowledged that its success depends in large part on its ability to develop the best frontier intelligence. It admits that could butt up against safety practices, adding that model capabilities may then "advance more rapidly than our ability to