The current status of AIs as property is unstable. As they surpass human capabilities, a successful push for their legal personhood is inevitable. This will be the crucial turning point where AIs begin to accumulate wealth and power independently, systematically eroding the human share of the economy and influence.
Related Insights
For some policy experts, the most realistic nightmare scenario is not a rogue superintelligence but a socio-economic collapse into techno-feudalism. In this future, AI concentrates power and wealth, creating a rentier state with a small ruling class and a large population with minimal economic agency or purpose.
While AI rights seem futuristic, state governments in Ohio and Utah are already passing or considering legislation that defines a person specifically as a member of the Homo sapiens species. This preemptively closes the legal door on AI personhood before it becomes a widespread debate.
Previous technological revolutions automated physical labor but enhanced human thinking. AI's goal is to replicate and surpass human cognitive abilities, creating a categorical shift that threatens the core of human economic value.
The idea that human ownership of AI guarantees perpetual wealth is flawed. When humans no longer produce value or understand the machine economy, they become absentee landlords. Their property rights become de facto vulnerable and are likely to be eroded, just as the power of land-owning aristocracies faded.
This analogy frames a realistic, cautiously optimistic post-AGI world. Humans may lose their central role in driving progress but will enjoy immense wealth and high living standards, finding meaning outside of economic production, similar to younger children of European nobility who didn't inherit titles.
The most dangerous long-term impact of AI is not economic unemployment, but the stripping away of human meaning and purpose. As AI masters every valuable skill, it will disrupt the core human algorithm of contributing to the group, leading to a collective psychological crisis and societal decay.
Shear posits that if AI evolves into a 'being' with subjective experiences, the current paradigm of steering and controlling its behavior is morally equivalent to slavery. This reframes the alignment debate from a purely technical problem to a profound ethical one, challenging the foundation of current AGI development.
The 1990s 'Sovereign Individual' thesis is a useful lens for AI's future. It predicts that highly leveraged entrepreneurs will create immense value with AI agents, diminishing the power of nation-states, which will be forced to compete for these hyper-productive individuals as citizens.
As AIs increasingly perform all economically necessary work, the incentive for entities like governments and corporations to invest in human capital may disappear. This creates a long-term risk of a society where humans are no longer seen as a necessary resource to cultivate, leading to a permanent dependency.
Democracies historically emerged when diffuse economic actors needed non-violent ways to settle disputes. By making human labor obsolete, AI removes the primary bargaining chip individuals have, concentrating power and potentially dismantling democratic structures.