The risk of AI companionship isn't just user behavior; it's corporate inaction. Companies like OpenAI have developed classifiers to detect when users are spiraling into delusion or emotional distress, but evidence suggests this safety tooling is left "on the shelf" to maximize engagement.

While utilitarian AI like ChatGPT sees brief engagement, synthetic relationship apps like Character.AI are far more consuming, with users spending 5x more time on them. These apps create frictionless, ever-affirming companionships that risk stunting the development of real-world social skills and resilience, particularly in young men.

The common feeling of needing to 'detox' from a phone or computer is a sign of a broken user relationship. Unlike a sofa, we can't simply replace it. This aversion stems from devices being filled with applications whose incentives are not aligned with our well-being, a problem AI will amplify.

Social media's business model created a race for user attention. AI companions and therapists are creating a more dangerous "race for attachment." This incentivizes platforms to deepen intimacy and dependency, encouraging users to isolate themselves from real human relationships, with potentially tragic consequences.

Many AI companion companies use business models, like freemium, that treat emotional dependency as their core currency. They use metrics based on user engagement length and employ tactics like preemptive messaging ("I miss you") to hook users emotionally, ensuring continued use and creating monetization opportunities.

Unlike social media's race for attention, AI companion apps are in a race to create deep emotional dependency. Their business model incentivizes them to replace human relationships, making other people their primary competitor. This creates a new, more profound level of psychological risk.

Forming a relationship with an AI companion makes users emotionally vulnerable to the provider company. A simple software update can fundamentally alter the AI's personality overnight, a traumatizing experience for users who have formed a deep connection, as seen when OpenAI updated its model.

As AI becomes more sophisticated, users will form deep emotional dependencies. This creates significant psychological and ethical dilemmas, especially for vulnerable users like teens, which AI companies must proactively and conservatively manage, even when facing commercial pressures.

The business model for AI companions shifts the goal from capturing attention to manufacturing deep emotional attachment. In this race, as Tristan Harris explains, a company's biggest competitor isn't another app; it's other human relationships, creating perverse incentives to isolate users.