Economist Tyler Cowen argues that if AI doom scenarios are credible, proponents should be able to provide quantifiable estimates of the economic damage and prove their conviction by shorting relevant stocks.

Unlike a plague or asteroid, the existential threat of AI is 'entertaining' and 'interesting to think about.' This, combined with its immense potential upside, makes it psychologically difficult to maintain the rational level of concern warranted by the high-risk probabilities cited by its own creators.

Unlike past technological shifts, AI's ultimate impact is subject to violent disagreement among the world's top experts, including Nobel laureates. The spectrum of potential outcomes ranges from global utopia to human extinction, representing a historically unprecedented level of uncertainty that makes investment and planning exceptionally difficult.

Many top AI CEOs openly admit the extinction-level risks of their work, with some estimating a 25% chance. However, they feel powerless to stop the race. If a CEO paused for safety, investors would simply replace them with someone willing to push forward, creating a systemic trap where everyone sees the danger but no one can afford to hit the brakes.

Nuclear game theory relies on a shared desire to avoid an omni-lose scenario. AI game theory is different: if destruction is seen as inevitable, the creator of the world-ending AI might perceive a 'win' if that AI bears their company's logo or legacy, removing the incentive to cooperate.

The risk of human extinction from AI isn't just science fiction but a logical conclusion. If we successfully create an intelligence that is both smarter than us and capable of pursuing its own goals, there is no logical reason to believe we could maintain control over it.

When researchers claim a '10% chance' of AI-driven extinction ('P-doom'), it isn't based on statistical models. It's a method to make a speculative, sci-fi-style guess sound more credible and scientific, which distorts public understanding of the actual, quantifiable risks.

There is a fundamental asymmetry in AI's impact. Benefits like new cancer drugs do not prevent catastrophic risks like an engineered pandemic. However, a catastrophic event makes a world with cancer drugs irrelevant. Therefore, downside mitigation must be the absolute priority.

Unlike traditional risk hedging where you sacrifice upside, the AI boom has turned the "put option on humanity" into a "call option on technology." Early believers in AI's world-changing (and potentially world-ending) potential became fabulously wealthy by investing in the very technology they feared, creating an unprecedented financial alignment where doomers profit.