While mitigating catastrophic AI risks is critical, the argument for safety can be used to justify placing powerful AI exclusively in the hands of a few actors. This centralization, intended to prevent misuse, simultaneously creates the monopolistic conditions for the Intelligence Curse to take hold.

The narrative of AI doom isn't just organic panic. It's being leveraged by established players who are actively seeking "regulatory capture." They aim to create a cartel that chokes off innovation from startups right from the start.

Prominent investors like David Sacks and Marc Andreessen claim that Anthropic employs a sophisticated strategy of fear-mongering about AI risks to encourage regulations. They argue this approach aims to create barriers for smaller startups, effectively solidifying the market position of incumbents under the guise of safety.

The narrative that AI could be catastrophic ('summoning the demon') is used strategically. It creates a sense of danger that justifies why a small, elite group must maintain tight control over the technology, thereby warding off both regulation and competition.

Bill Gurley voices concern that large AI companies like Anthropic, which are lobbying heavily, might be using regulation as a competitive weapon. This "regulatory capture" tactic would create high barriers to entry, stifling innovation from smaller startups and open-source projects, effectively "pulling up the ladder" behind them.

Gurley suggests that public warnings about AI's existential risks from leaders at top US AI firms could be a strategic move to invite regulation. This 'regulatory capture' would stifle smaller competitors and could inadvertently cede the global AI market to less-regulated players like China.

The rhetoric around AI's existential risks is framed as a competitive tactic. Some labs used these narratives to scare investors, regulators, and potential competitors away, effectively 'pulling up the ladder' to cement their market lead under the guise of safety.

Leading AI companies allegedly stoke fears of existential risk not for safety, but as a deliberate strategy to achieve regulatory capture. By promoting scary narratives, they advocate for complex pre-approval systems that would create insurmountable barriers for new startups, cementing their own market dominance.

Large AI labs cynically use existential risk arguments, originally from 'effective altruist' communities, to lobby for regulations that stifle competition. This strategy aims to create monopolies by targeting open-source models and international rivals like China.