When AI founders publicly catastrophize about the existential risks of their technology after cashing out, it's often a calculated marketing tactic. This narrative frames the technology as world-changing and immensely powerful, which serves as a compelling, if indirect, pitch to invest in their companies and support their valuations.

Public proclamations of AI-driven extinction, like an Anthropic researcher's 10% odds of human annihilation, may be a deliberate strategy. By presenting worst-case scenarios, these individuals aim to trigger urgent conversations and push the industry and regulators toward implementing stronger safety measures.

The narrative that AI could be catastrophic ('summoning the demon') is used strategically. It creates a sense of danger that justifies why a small, elite group must maintain tight control over the technology, thereby warding off both regulation and competition.

A strange dynamic exists where the tech leaders building AI are also the loudest voices warning of its potential to destroy humanity. This dual narrative of immense promise and existential threat serves to centralize their power, positioning them as the only ones who can both create and control this technology.

The rhetoric around AI's existential risks is framed as a competitive tactic. Some labs used these narratives to scare investors, regulators, and potential competitors away, effectively 'pulling up the ladder' to cement their market lead under the guise of safety.

The narrative that AI risk-awareness is just "doomerism" is a recent phenomenon, strategically pushed by those who stand to benefit commercially from unchecked AI development. In reality, concerns about superintelligence risks have been foundational to the AI industry for decades.

AI leaders' messaging about world-ending risks, while effective for fundraising, creates public fear. To gain mainstream acceptance, the industry needs a Steve Jobs-like figure to shift the narrative from AI as an autonomous, job-killing force to AI as a tool that empowers human potential.

Sam Harris highlights the bizarre cultural phenomenon of AI leaders openly stating high probabilities (e.g., 20%) for existential risk while racing to build the technology. He contrasts this with Manhattan Project scientists, who proceeded only after calculating the risk of igniting the atmosphere as infinitesimal, not a double-digit percentage.

The narrative of AI's world-changing power and existential risk may be fueled by CEOs' vested interest in securing enormous investments. By framing the technology as revolutionary and dangerous, it justifies higher valuations and larger funding rounds, as Scott Galloway suggests for companies like Anthropic.