Top AI companies like OpenAI and Anthropic cannot unilaterally slow development, even with safety concerns. They fear that competitors or foreign adversaries would seize an insurmountable advantage, forcing them to seek government-led coordination to pace development safely.

The proposed data center moratorium, while intended to address safety, would create a strategic advantage for China and other nations if enacted unilaterally. An American slowdown without global agreement allows adversaries to catch up or surpass the US in AI, highlighting the prisoner's dilemma inherent in global AI regulation.

The development of AI won't stop because of game theory. For competing nations like the US and China, the risk of falling behind is greater than the collective risk of developing the technology. This dynamic makes the AI race an unstoppable force, mirroring the Cold War nuclear arms race and rendering calls for a pause futile.

Top AI labs like Anthropic publicly state that slowing down AI development would benefit society. However, they are caught in a strategic trap: a unilateral pause is unviable. Without a global agreement, any lab that pauses simply allows less cautious competitors to seize the lead, potentially making the ecosystem less safe.

Leaders at top AI labs publicly state that the pace of AI development is reckless. However, they feel unable to slow down due to a classic game theory dilemma: if one lab pauses for safety, others will race ahead, leaving the cautious player behind.

CEOs from leading AI labs like Google DeepMind and Anthropic have publicly stated they would prefer to slow down development to address safety concerns. However, they feel compelled to continue the race because if they pause unilaterally, less cautious competitors, including state actors like China, will not.

The "Pacing the Frontier" letter, where AI employees ask for government-mandated slowdowns, highlights a prisoner's dilemma. No single lab can afford to slow down due to "competitive pressure" unless all are forced to do so simultaneously through regulation. This coordination problem is why they appeal to an external authority.

Governments face a difficult choice with AI regulation. Those that impose strict safety measures risk falling behind nations with a laissez-faire approach. This creates a global race condition where the fear of being outcompeted may discourage necessary safeguards, even when the risks are known.

The immense strategic advantage offered by AI ensures its development will continue, regardless of safety concerns from insiders. Much like the Manhattan Project, which proceeded despite catastrophic risk, the logic of "if we don't, China will" makes unilateral cessation of research impossible for any major power.