The primary danger from AI in the coming years may not be the technology itself, but society's inability to cope with the rapid, disorienting change it creates. This could lead to a 'civilizational-scale psychosis' as our biological and social structures fail to keep pace, causing a breakdown in identity and order.

The potential for an AI-driven, post-capitalist world of abundance is real. However, the path there will likely be as destructive as a world war, as the rapid upending of the economic order will throw society into chaos before stability is achieved.

AI will solve major problems like disease and resource scarcity. However, the benefits will not be distributed evenly or simultaneously. This rapid, uneven change will create massive social and economic disruption, making the maintenance of social order the biggest challenge for humanity.

Martin Wolf frames AI not as just a technology but as a philosophical pact. We are gaining a powerful servant that raises existential questions about humanity's purpose and creates terrifying risks like unaccountable decision-making and AI-run armies.

Even if AI is a perfect success with no catastrophic risk, our society may still crumble. We lack the political cohesion and shared values to agree on fundamental solutions like Universal Basic Income (UBI) that would be necessary to manage mass unemployment, turning a technological miracle into a geopolitical crisis.

For some policy experts, the most realistic nightmare scenario is not a rogue superintelligence but a socio-economic collapse into techno-feudalism. In this future, AI concentrates power and wealth, creating a rentier state with a small ruling class and a large population with minimal economic agency or purpose.

Even if AI remains aligned and power isn't dangerously concentrated, humanity could still face gradual disempowerment. In this scenario, humans are simply competed out of the economy and lose agency in a world that becomes unfriendly to them. Currently, few proposals exist to prevent this outcome.

When AI and robots can do everything better than humans, our sense of self-worth, which is often tied to our useful contributions, is threatened. This creates a profound existential challenge, even in a world of abundance.

While AI may eventually create a world of abundance where energy and labor are free, the transition will be violent. The unprecedented scale of job displacement, coupled with a societal loss of meaning, will likely lead to significant bloodshed and social upheaval before any utopian endpoint is reached.