The concept of AGI is so ill-defined it becomes a catch-all for magical thinking, both utopian and dystopian. Casado argues it erodes the quality of discourse by preventing focus on concrete, solvable problems and measurable technological progress.

Even if AI is a perfect success with no catastrophic risk, our society may still crumble. We lack the political cohesion and shared values to agree on fundamental solutions like Universal Basic Income (UBI) that would be necessary to manage mass unemployment, turning a technological miracle into a geopolitical crisis.

The idea that AI development is a winner-take-all race to AGI is a compelling story that simplifies complex realities. This narrative is strategically useful as it creates a pretext for aggressive, 'do whatever it takes' behavior, sidestepping the messier nature of real-world conflict.

Unlike previous technologies like the internet or smartphones, which enjoyed years of positive perception before scrutiny, the AI industry immediately faced a PR crisis of its own making. Leaders' early and persistent "AI will kill everyone" narratives, often to attract capital, have framed the public conversation around fear from day one.

The rhetoric around AI's existential risks is framed as a competitive tactic. Some labs used these narratives to scare investors, regulators, and potential competitors away, effectively 'pulling up the ladder' to cement their market lead under the guise of safety.

Leaders in AI and robotics appear to accept the risks of creating potentially uncontrollable, human-like AI, exemplified by their embrace of a 'Westworld' future. This 'why not?' attitude suggests a culture where the pursuit of technological possibility may overshadow cautious ethical deliberation and risk assessment.

Dr. Li rejects both utopian and purely fatalistic views of AI. Instead, she frames it as a humanist technology—a double-edged sword whose impact is entirely determined by human choices and responsibility. This perspective moves the conversation from technological determinism to one of societal agency and stewardship.

AI leaders' messaging about world-ending risks, while effective for fundraising, creates public fear. To gain mainstream acceptance, the industry needs a Steve Jobs-like figure to shift the narrative from AI as an autonomous, job-killing force to AI as a tool that empowers human potential.

AI leaders often use dystopian language about job loss and world-ending scenarios (“summoning the demon”). While effective for fundraising from investors who are "long demon," this messaging is driving a public backlash by framing AI as an existential threat rather than an empowering tool for humanity.