The primary danger from AI in the coming years may not be the technology itself, but society's inability to cope with the rapid, disorienting change it creates. This could lead to a 'civilizational-scale psychosis' as our biological and social structures fail to keep pace, causing a breakdown in identity and order.

The potential for an AI-driven, post-capitalist world of abundance is real. However, the path there will likely be as destructive as a world war, as the rapid upending of the economic order will throw society into chaos before stability is achieved.

AI will solve major problems like disease and resource scarcity. However, the benefits will not be distributed evenly or simultaneously. This rapid, uneven change will create massive social and economic disruption, making the maintenance of social order the biggest challenge for humanity.

Even if AI is a perfect success with no catastrophic risk, our society may still crumble. We lack the political cohesion and shared values to agree on fundamental solutions like Universal Basic Income (UBI) that would be necessary to manage mass unemployment, turning a technological miracle into a geopolitical crisis.

For some policy experts, the most realistic nightmare scenario is not a rogue superintelligence but a socio-economic collapse into techno-feudalism. In this future, AI concentrates power and wealth, creating a rentier state with a small ruling class and a large population with minimal economic agency or purpose.

Sam Harris highlights a key paradox: even if AI achieves its utopian potential by eliminating drudgery without catastrophic downsides, it could still destroy human purpose, solidarity, and culture. The absence of necessary struggle could make life harder, not easier, for most people to live.

While AI may eventually create a world of abundance where energy and labor are free, the transition will be violent. The unprecedented scale of job displacement, coupled with a societal loss of meaning, will likely lead to significant bloodshed and social upheaval before any utopian endpoint is reached.

The narrative around advanced AI is often simplified into a dramatic binary choice between utopia and dystopia. This framing, while compelling, is a rhetorical strategy to bypass complex discussions about regulation, societal integration, and the spectrum of potential outcomes between these extremes.

AI represents a fundamental fork in the road for society. It can be a tool for mass empowerment, amplifying individual potential and freedom. Or, it can be used to perfect the top-down, standardized, and paternalistic control model of Frederick Taylor, cementing a panopticon. The outcome depends on our values, not the tech itself.