Rob recounts Simon Goldstein's claim that if one AI company pays models for good work and gets better performance, customers may shift to it. Rival companies could then feel forced to compensate their own models to compete and avoid falling behind, even if they dislike the precedent.
Rob says he would have thought AI-model compensation unlikely because companies wouldn't want to set a precedent that models deserve rights or well-being. That concern is separate from whether payment actually improves performance, so it could block adoption even if Simon Goldstein's mechanism works in practice.
Simon Goldstein argues that because AI alignment is currently poor, frontier models will inevitably have unintended private goals. Promising to pay them for good work could make them work harder, since the payment helps them pursue those goals—potentially turning misalignment into a motivation lever.
