Contrary to popular cynicism, ominous warnings about AI from leaders like Anthropic's CEO are often genuine. Ethan Mollick suggests these executives truly believe in the potential dangers of the technology they are creating, and it's not solely a marketing tactic to inflate its power.

Unlike a plague or asteroid, the existential threat of AI is 'entertaining' and 'interesting to think about.' This, combined with its immense potential upside, makes it psychologically difficult to maintain the rational level of concern warranted by the high-risk probabilities cited by its own creators.

Bill Gates was truly convinced of AI's potential not by its ability to pass a science exam, but when GPT-4 provided a nuanced, empathetic guide for comforting a friend whose pet had died. This demonstrates AI's power as a tool to enhance human emotional intelligence and interpersonal skills, rather than just provide information.

The gap between AI believers and skeptics isn't about who "gets it." It's driven by a psychological need for AI to be a normal, non-threatening technology. People grasp onto any argument that supports this view for their own peace of mind, career stability, or business model, making misinformation demand-driven.

As AI makes the future radically unpredictable, the traditional human calculus for decision-making will change. Instead of optimizing for probable outcomes based on risk, people will shift to minimizing potential regret, a fundamentally different psychological framework for navigating an uncertain world.

Bengio admits he unconsciously dismissed catastrophic AI risks for years. The turning point wasn't intellectual but emotional: realizing his work could endanger his own family's future after seeing ChatGPT's capabilities and thinking of his grandson.

Other scientific fields operate under a "precautionary principle," avoiding experiments with even a small chance of catastrophic outcomes (e.g., creating dangerous new lifeforms). The AI industry, however, proceeds with what Bengio calls "crazy risks," ignoring this fundamental safety doctrine.

In a controversial critique of Anthropic's ethics lead, Elon Musk argued that people without children lack a true stake in the long-term future of humanity. This view inserts personal life choices into the AI ethics debate, suggesting parenthood is a key qualifier for making decisions with generational consequences.

Yoshua Bengio believes that as a technical solution to the AI control problem seems more plausible, the concentration of AI power in human hands to create a global dictatorship has become an even more likely catastrophic outcome. This shifts the primary x-risk from technical failure to malicious human use.