Anthropic Calls for AI Development Pause Ahead of IPO

Anthropic is urging leading artificial intelligence companies to consider a coordinated pause in development, warning that AI systems may soon gain the ability to improve themselves faster than society can manage the consequences.

The company behind the Claude AI assistant said in a blog post Thursday that AI task-completion capabilities have been doubling roughly every four months, approaching what researchers call "recursive self-improvement"—the point where systems can enhance themselves without human intervention.

"If systems are capable of fully building their own successors, the ways we secure them, monitor them, and shape their behavior all grow much more important," wrote Anthropic co-founder Jack Clark and Anthropic Institute lead Marina Favaro. They emphasized that while this threshold hasn't been reached, "it could come sooner than most institutions are prepared for."

Why it matters

The call comes as Anthropic confidentially filed for a U.S. initial public offering this week following a funding round that valued the company at $965 billion. The timing underscores growing tension between commercial pressures driving rapid AI advancement and mounting concerns about safety—a conflict playing out across the industry as companies race to deploy increasingly powerful systems while regulatory frameworks lag behind.

The challenge of coordination

Anthropic acknowledged that unilateral slowdowns could backfire if less safety-conscious competitors continue advancing unchecked. The company said a meaningful pause would require agreement among "multiple well-resourced labs" at the technological frontier, along with clear criteria for triggering and lifting such pauses and oversight mechanisms.

"A unilateral pause by one lab, by contrast, is achievable immediately, but accomplishes much less: it would change who the front-runner is, but it would not create the wider deliberative process that is currently missing," the company stated.

The Anthropic Institute plans to convene policymakers, researchers, civil society organizations, and rival AI firms in coming months to discuss managing risks associated with recursive self-improvement.

Previous pause efforts and regulatory gaps

This isn't the first call for an AI development pause. In 2023, the Future of Life Institute—backed by figures including Elon Musk—proposed a six-month halt to allow time for safety guardrails, though the effort gained little traction.

Regulation has moved slowly, particularly in the United States where most leading AI labs operate. A recent Trump administration executive order placed responsibility on the labs themselves, requesting voluntary submission of their most capable models for government cybersecurity testing before public release.

Anthropic's safety contradictions

Anthropic has positioned itself as a safety-focused AI company, refusing earlier this year to allow U.S. military use of its models for domestic surveillance and fully autonomous weapons. That decision led to the company being placed on a national security blacklist set to take effect later in 2026, though Reuters reported Friday that the dispute shows signs of easing.

Yet the company has continued releasing increasingly powerful models and in February walked back a key safety commitment, stating it would no longer hold back potentially dangerous AI if competitors were close to matching its capabilities.

Competing AI labs including OpenAI, xAI, Alphabet, Meta Platforms, and Mistral did not immediately respond to requests for comment on whether they would support the pause proposal.

These details were first reported by CNBC.