While the public focuses on AI's potential, a small group of tech leaders is using the current unregulated environment to amass unprecedented power and wealth. The federal government is even blocking state-level regulations, ensuring these few individuals gain extraordinary control.

While mitigating catastrophic AI risks is critical, the argument for safety can be used to justify placing powerful AI exclusively in the hands of a few actors. This centralization, intended to prevent misuse, simultaneously creates the monopolistic conditions for the Intelligence Curse to take hold.

The narrative that AI could be catastrophic ('summoning the demon') is used strategically. It creates a sense of danger that justifies why a small, elite group must maintain tight control over the technology, thereby warding off both regulation and competition.

A ban on superintelligence is self-defeating because enforcement would require a sanctioned, global government body to build the very technology it prohibits in order to "prove it's safe." This paradoxically creates a state-controlled monopoly on the most powerful technology ever conceived, posing a greater risk than a competitive landscape.

By restricting its most powerful model, Mythos, to a consortium of large companies, Anthropic is creating a two-tier economy. Smaller companies are left without access to the same advanced offensive and defensive AI capabilities, ending the previously democratic access to cutting-edge models and creating a significant competitive disadvantage.

The risk of malicious actors using powerful AI decision tools is significant. The most effective countermeasure is not to restrict the technology, but to ensure it is widely and equitably distributed. This prevents any single group from gaining a dangerous strategic advantage over others.

While often proposed to manage safety, a centralized, government-led AGI project is highly dangerous from a power concentration perspective. It removes checks and balances by consolidating immense capability within a single entity, whether it's one country or one company collaborating with the government.

The fear of killer AI is misplaced. The more pressing danger is that a few large companies will use regulation to create a cartel, stifling innovation and competition—a historical pattern seen in major US industries like defense and banking.

Meredith Whittaker argues the biggest AI threat is not a sci-fi apocalypse, but the consolidation of power. AI's core requirements—massive data, computing infrastructure, and distribution channels—are controlled by a handful of established tech giants, further entrenching their dominance.