Anthropic's public focus on AI doomerism and safety isn't just ideological; it's a strategic move. By positioning themselves as the "safe" player, they can influence regulation to create a closed environment with few competitors, creating an information asymmetry they can exploit.

While mitigating catastrophic AI risks is critical, the argument for safety can be used to justify placing powerful AI exclusively in the hands of a few actors. This centralization, intended to prevent misuse, simultaneously creates the monopolistic conditions for the Intelligence Curse to take hold.

Leading AI companies allegedly stoke fears of existential risk not for safety, but as a deliberate strategy to achieve regulatory capture. By promoting scary narratives, they advocate for complex pre-approval systems that would create insurmountable barriers for new startups, cementing their own market dominance.

The "Pacing the Frontier" letter, where AI employees ask for government-mandated slowdowns, highlights a prisoner's dilemma. No single lab can afford to slow down due to "competitive pressure" unless all are forced to do so simultaneously through regulation. This coordination problem is why they appeal to an external authority.

Calls to regulate AI based on speculative futures like Artificial General Intelligence (AGI) are a flawed basis for policy. These predictions have a poor track record and are often self-serving arguments used by incumbents to justify regulations that entrench their market position today.

Governments face a difficult choice with AI regulation. Those that impose strict safety measures risk falling behind nations with a laissez-faire approach. This creates a global race condition where the fear of being outcompeted may discourage necessary safeguards, even when the risks are known.

AI expert Max Tegmark argues that regulation, like the FDA for pharma, would shift incentives. Instead of a 'race to the bottom' on unchecked capabilities, companies would compete to be first to develop provably safe AI. This would create a golden age of innovation in areas like medicine while sidelining riskier applications.

An FDA-style regulatory model would force AI companies to make a quantitative safety case for their models before deployment. This shifts the burden of proof from regulators to creators, creating powerful financial incentives for labs to invest heavily in safety research, much like pharmaceutical companies invest in clinical trials.

The tech industry is backing a self-regulatory body (SRO) to pre-empt a government agency that could take 5-9 years to approve new AI models. This proactive step aims to prevent a bureaucratic slowdown that would cede the US's innovation speed advantage to competitors like China.