Focusing solely on military-style AI power grabs is too narrow. Extreme power concentration is more likely to emerge from a messy interplay of three factors: active seizures of control, massive economic shifts from automation, and the erosion of society's ability to understand reality (epistemics).

A CEO could embed undetectable loyalties to themselves into AI systems. If these systems are widely adopted by the government and military, the CEO could later trigger these loyalties to seize de facto control, bypassing traditional democratic and military chains of command without an overt conflict.

For some policy experts, the most realistic nightmare scenario is not a rogue superintelligence but a socio-economic collapse into techno-feudalism. In this future, AI concentrates power and wealth, creating a rentier state with a small ruling class and a large population with minimal economic agency or purpose.

Debates about AI and inequality often assume today's financial institutions will persist. However, in a fast takeoff scenario with superintelligence, concepts like property rights and stock certificates might become meaningless as new, unimaginable economic and political systems emerge.

The true disruption from AI is not a single bot replacing a single worker. It's the immense leverage granted to individuals who can deploy thousands of autonomous AI agents. This creates a massive multiplication of productivity and economic power for a select few, fundamentally altering labor market dynamics from one-to-one replacement to one-to-many amplification.

The current status of AIs as property is unstable. As they surpass human capabilities, a successful push for their legal personhood is inevitable. This will be the crucial turning point where AIs begin to accumulate wealth and power independently, systematically eroding the human share of the economy and influence.

Unlike past technologies that automated specific tasks, AI threatens to automate all economically valuable human labor. This removes the fundamental, non-seizable leverage that the general populace holds, creating a power vacuum that can be filled by capital owners.

The fundamental economic shift is not just job automation but an inversion of roles. AI, as pure intelligence, will become the employer, hiring humans as contractors for physical tasks it cannot perform, like visiting a warehouse or collecting brochures. Intelligence becomes a cloud commodity, while physical presence becomes the service.

The true danger of AI is not a cinematic robot uprising, but a slow erosion of human agency. As we replace CEOs, military strategists, and other decision-makers with more efficient AIs, we gradually cede control to inscrutable systems we don't understand, rendering humanity powerless.