The only viable path for AI regulation is to treat it as a dual-use technology, similar to nuclear energy. Governments must clearly delineate and control 'weapons-grade' AI while fostering innovation in 'civilian use' AI. A failure to do so risks either falling behind in a global arms race or allowing dangerous capabilities to proliferate.

Public debate often focuses on whether AI is conscious. This is a distraction. The real danger lies in its sheer competence to pursue a programmed objective relentlessly, even if it harms human interests. Just as an iPhone chess program wins through calculation, not emotion, a superintelligent AI poses a risk through its superior capability, not its feelings.

When AI leaders acknowledge even a small chance of human extinction, it forces a governmental response. The only historical precedent for managing private-sector tech with true existential risk (e.g., nuclear weapons) is nationalization, eliminating the middle ground for responsible private innovation.

The popular comparison of AI to nuclear weapons has a critical flaw. Nuclear regulation relies on tracking scarce, physical, and interceptable fissionable materials. AI, as software and weights, can be copied and distributed far more easily, making the nuclear non-proliferation playbook a poor and dangerous model for AI governance.

Instead of broad, paralyzing regulation that could stifle innovation, a more effective approach is to create a clear distinction between AI with weaponization potential and AI for civilian use. This mirrors the dual-use framework for nuclear technology, allowing progress while managing existential risks.

The heads of Anthropic, OpenAI, and Google are advocating for AI regulation by comparing its existential risk to nuclear power. This analogy intentionally elevates the threat level beyond typical tech disruption (like social media) to necessitate government oversight and international treaties, similar to nuclear arms control.

Comparing superintelligence to nuclear weapons is flawed. Nuclear weapons are tools requiring human actors to be deployed. Superintelligence will be an autonomous agent making its own decisions. You can't ensure safety by controlling a human "dictator," because the agent itself operates independently.

The comparison to nuclear proliferation suggests AI's potential for harm is too great for private, profit-driven companies to manage. A prominent, typically anti-government technologist argued that President Truman would have nationalized AI, indicating the tech has reached a level of danger requiring state control.

By constantly comparing AI's power to nuclear weapons, tech leaders are making a powerful argument against their own independence. If the technology is truly an existential threat, it logically follows that it should be government-controlled for national security, not managed by venture-backed startups.