While the public focuses on AI's potential, a small group of tech leaders is using the current unregulated environment to amass unprecedented power and wealth. The federal government is even blocking state-level regulations, ensuring these few individuals gain extraordinary control.

While aimed at safety, proposed regulations could inadvertently create massive barriers to entry. The high cost and complexity of compliance would favor a few large, established AI labs, effectively giving them regulatory capture and stifling competition from smaller players and startups who can't make the cut.

The narrative of uncontrollable AI serves large incumbents like OpenAI. They use fear to push for regulations that create high barriers to entry for competitors and shield them from liability, effectively building a government-protected moat around their business.

For some policy experts, the most realistic nightmare scenario is not a rogue superintelligence but a socio-economic collapse into techno-feudalism. In this future, AI concentrates power and wealth, creating a rentier state with a small ruling class and a large population with minimal economic agency or purpose.

The decision to restrict powerful but dangerous AI models like Claude Mythos to a select group of large corporations for safety reasons risks creating a massive centralization of power. This gives these entities an insurmountable technological advantage over smaller players and the public.

Contrary to the idea of AI for all, the most powerful models will likely be restricted to a few high-paying clients to prevent distillation and maximize revenue. This creates a future where competitive advantage is defined by exclusive AI access, potentially allowing large incumbents to crush smaller competitors.

The fear of killer AI is misplaced. The more pressing danger is that a few large companies will use regulation to create a cartel, stifling innovation and competition—a historical pattern seen in major US industries like defense and banking.

Meredith Whittaker argues the biggest AI threat is not a sci-fi apocalypse, but the consolidation of power. AI's core requirements—massive data, computing infrastructure, and distribution channels—are controlled by a handful of established tech giants, further entrenching their dominance.

Unlike past tech waves where companies resisted government oversight, today's AI leaders are actively inviting it. This is a strategic move to shape regulations in their favor, creating barriers to entry for smaller players and open-source competitors under the guise of safety and responsibility.