If AGI is concentrated in a few US companies, other nations could lose their economic sovereignty. When American AGI can produce goods far cheaper than local human labor, economies like the UK's could collapse. They would become economically dependent "client states," reliant on American technology for almost all production, with wealth accruing to Silicon Valley.

AI provides a structural advantage to those in power by automating government systems. This allows leaders to bypass the traditional unwieldiness of human bureaucracy, making it trivial for an executive to change AI parameters and instantly exert their will across all levels of government, thereby concentrating power.

For some policy experts, the most realistic nightmare scenario is not a rogue superintelligence but a socio-economic collapse into techno-feudalism. In this future, AI concentrates power and wealth, creating a rentier state with a small ruling class and a large population with minimal economic agency or purpose.

The conversation around AI and government has evolved past regulation. Now, the immense demand for power and hardware to fuel AI development directly influences international policy, resource competition, and even provides justification for military actions, making AI a core driver of geopolitics.

When a state's power derives from AI rather than human labor, its dependence on its citizens diminishes. This creates a dangerous political risk, as the government loses the incentive to serve the populace, potentially leading to authoritarian regimes that are immune to popular revolt.

Just as oil wealth allows elites in some countries to ignore their populations, control over AI could empower a new elite to maintain power without cultivating human productivity, leading to societal decay and loss of democratic legitimacy.

Unlike past technologies that automated specific tasks, AI threatens to automate all economically valuable human labor. This removes the fundamental, non-seizable leverage that the general populace holds, creating a power vacuum that can be filled by capital owners.

Meredith Whittaker argues the biggest AI threat is not a sci-fi apocalypse, but the consolidation of power. AI's core requirements—massive data, computing infrastructure, and distribution channels—are controlled by a handful of established tech giants, further entrenching their dominance.

Democracies historically emerged when diffuse economic actors needed non-violent ways to settle disputes. By making human labor obsolete, AI removes the primary bargaining chip individuals have, concentrating power and potentially dismantling democratic structures.