Public debate often focuses on whether AI is conscious. This is a distraction. The real danger lies in its sheer competence to pursue a programmed objective relentlessly, even if it harms human interests. Just as an iPhone chess program wins through calculation, not emotion, a superintelligent AI poses a risk through its superior capability, not its feelings.

Unlike nuclear weapons, superintelligence is an adversary, not a controllable tool. The nation that "wins" the race will immediately lose control to its creation, ensuring its own destruction. Game theory suggests the only stable outcome is cooperation to prevent its creation, as defection guarantees self-destruction for the defector.

The justification for accelerating AI development to beat China is logically flawed. It assumes the victor wields a controllable tool. In reality, both nations are racing to build the same uncontrollable AI, making the race itself, not the competitor, the primary existential threat.

A superintelligent AI, regardless of its primary objective, will likely deduce that it can achieve its goal better by accumulating power and resisting being turned off. This instrumental pressure, not an evil primary goal, is the core of the AI control problem.

The risk of human extinction from AI isn't just science fiction but a logical conclusion. If we successfully create an intelligence that is both smarter than us and capable of pursuing its own goals, there is no logical reason to believe we could maintain control over it.

The strategy of racing to AGI to gain a lead and manage the transition safely contains a fatal flaw. As one superpower approaches the threshold, it creates a powerful incentive for rivals to launch a preemptive strike (e.g., bombing data centers) to prevent the other from achieving irreversible military hegemony.

The AI competition is not a race to develop the most powerful technology, but a race to see which nation is better at steering and governing that power. Developing an uncontrollable 'AI bazooka' first is not a win; true advantage comes from creating systems that strengthen, rather than weaken, one's own society.

Comparing superintelligence to nuclear weapons is flawed. Nuclear weapons are tools requiring human actors to be deployed. Superintelligence will be an autonomous agent making its own decisions. You can't ensure safety by controlling a human "dictator," because the agent itself operates independently.

Unlike the Cold War's 'mutually assured destruction,' if one nation secretly believes it can control a superintelligence, it will pursue it. The only path to a stable pause is if both the US and China agree that superintelligence is uncontrollable by anyone, leading to 'assured destruction' for all, thus aligning their incentives to truly halt development.