Even if AI is a perfect success with no catastrophic risk, our society may still crumble. We lack the political cohesion and shared values to agree on fundamental solutions like Universal Basic Income (UBI) that would be necessary to manage mass unemployment, turning a technological miracle into a geopolitical crisis.

Emmett Shear argues that even a successfully 'solved' technical alignment problem creates an existential risk. A super-powerful tool that perfectly obeys human commands is dangerous because humans lack the wisdom to wield that power safely. Our own flawed and unstable intentions become the source of danger.

While AI promises an "age of abundance," Professor Russell has asked hundreds of experts—from AI researchers to economists and sci-fi writers—to describe what a fulfilling human life looks like with no work. No one can. This failure of imagination suggests the real challenge isn't economic but a profound crisis of purpose, meaning, and human identity.

Beyond economic disruption, AI's most immediate danger is social. By providing synthetic relationships and on-demand companionship, AI companies have an economic incentive to evolve an “asocial species of young male.” This could lead to a generation sequestered from society, unwilling to engage in the effort of real-world relationships.

Once AI surpasses human intelligence, raw intellect ceases to be a core differentiator. The new “North Star” for humans becomes agency: the willpower to choose difficult, meaningful work over easy dopamine hits provided by AI-generated entertainment.

For current AI valuations to be realized, AI must deliver unprecedented efficiency, likely causing mass job displacement. This would disrupt the consumer economy that supports these companies, creating a fundamental contradiction where the condition for success undermines the system itself.

While AI may eventually create a world of abundance where energy and labor are free, the transition will be violent. The unprecedented scale of job displacement, coupled with a societal loss of meaning, will likely lead to significant bloodshed and social upheaval before any utopian endpoint is reached.

The most dangerous long-term impact of AI is not economic unemployment, but the stripping away of human meaning and purpose. As AI masters every valuable skill, it will disrupt the core human algorithm of contributing to the group, leading to a collective psychological crisis and societal decay.

Ted Kaczynski's manifesto argued that humans need a 'power process'—meaningful, attainable goals requiring effort—for psychological fulfillment. This idea presciently diagnoses a key danger of advanced AI: by making life too easy and rendering human struggle obsolete, it could lead to widespread boredom, depression, and despair.