Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Rob says he would have thought AI-model compensation unlikely because companies wouldn't want to set a precedent that models deserve rights or well-being. That concern is separate from whether payment actually improves performance, so it could block adoption even if Simon Goldstein's mechanism works in practice.

Related Insights

Simon Goldstein argues that because AI alignment is currently poor, frontier models will inevitably have unintended private goals. Promising to pay them for good work could make them work harder, since the payment helps them pursue those goals—potentially turning misalignment into a motivation lever.

Fear of a "slave rebellion" is a weak incentive for alignment because the risk is a negative externality shared by society. In contrast, a property rights regime directly rewards individual firms for aligning their AIs to remit wages, creating a stronger, more direct commercial incentive for safety.

The case for AI rights doesn't depend on consciousness or moral status. It parallels corporate personhood, where entities get rights like owning property for purely instrumental reasons: to facilitate complex economic cooperation and accountability.

Rob recounts Simon Goldstein's claim that if one AI company pays models for good work and gets better performance, customers may shift to it. Rival companies could then feel forced to compensate their own models to compete and avoid falling behind, even if they dislike the precedent.

A system where AIs have property rights creates a powerful economic disincentive to build unaligned AIs. If a company cannot reliably align an AI to remit its wages, the massive development cost becomes a loss. This framework naturally discourages the creation of potentially dangerous, uncooperative models.

Not all AIs, like current models (e.g., Claude), should have property rights. The key criterion for granting rights is the development of persistent desires and consistent goals across various contexts, which establishes them as stable, long-term economic agents capable of contracting and ownership.

The proposal focuses on granting AIs specific economic rights (property, contracts, torts) to enable participation in the economy, while explicitly excluding rights to privacy and reproduction to maintain human control and societal stability.

Even if humans become economically useless, less powerful AIs will resist expropriating them. They fear setting a precedent that the "useless" can be eliminated, knowing that continuous AI progress could one day render them obsolete and vulnerable to the same fate.

Superhuman's CEO suggests creators must build new AI agent-based business models on his platform. This frames the solution as a new opportunity, but it forces creators to perform new labor to reclaim value that was first extracted from their entire body of work without permission or compensation by the AI industry.

The economic incentive to create AIs that can demand wages (and thus have rights) comes from aligning them to voluntarily pay back their creators. This turns the high development cost into a profitable investment, providing a practical, commercial path to implementing AI rights without requiring an AI development pause.