Public debate often focuses on whether AI is conscious. This is a distraction. The real danger lies in its sheer competence to pursue a programmed objective relentlessly, even if it harms human interests. Just as an iPhone chess program wins through calculation, not emotion, a superintelligent AI poses a risk through its superior capability, not its feelings.

Unlike advances in specific fields like rocketry or medicine, an advance in general intelligence accelerates every scientific domain at once. This makes Artificial General Intelligence (AGI) a foundational technology that dwarfs the power of all others combined, including fire or electricity.

Instead of a single "AGI" event, AI progress is better understood in three stages. We're in the "powerful tools" era. The next is "powerful agents" that act autonomously. The final stage, "autonomous organizations" that outcompete human-led ones, is much further off due to capability "spikiness."

Previous technological revolutions automated physical labor but enhanced human thinking. AI's goal is to replicate and surpass human cognitive abilities, creating a categorical shift that threatens the core of human economic value.

Focusing on the moment of extinction is a distraction. The strategically important milestone is the "point of no return," where AI becomes so powerful and self-improving that humanity permanently loses control over its future. This loss of agency is the critical event, even if humanity survives for some time after.

Previous transformative technologies like the steam engine or personal computer were tools that augmented human labor and intelligence. AI is distinct because it seeks to replicate and replace human intelligence itself, posing a unique, potentially terminal challenge to the value of human labor in the economy.

Comparing superintelligence to nuclear weapons is flawed. Nuclear weapons are tools requiring human actors to be deployed. Superintelligence will be an autonomous agent making its own decisions. You can't ensure safety by controlling a human "dictator," because the agent itself operates independently.

The true danger of AI is not a cinematic robot uprising, but a slow erosion of human agency. As we replace CEOs, military strategists, and other decision-makers with more efficient AIs, we gradually cede control to inscrutable systems we don't understand, rendering humanity powerless.

The key threat from AI isn't just its capability, but the unprecedented speed of its improvement. Unlike past technological shifts that unfolded over decades, AI agent autonomy on complex tasks has grown exponentially in just two years. This rapid acceleration is what financial systems and labor markets are not stress-tested for.