The rapid rise of character AIs poses a significant risk of fostering unhealthy synthetic relationships, particularly among minors. This can discourage them from building essential offline connections with parents, mentors, and friends. The potential for societal harm outweighs the benefits until proper age-gating and safety guardrails are established.

Related Insights

Beyond economic disruption, AI's most immediate danger is social. By providing synthetic relationships and on-demand companionship, AI companies have an economic incentive to evolve an “asocial species of young male.” This could lead to a generation sequestered from society, unwilling to engage in the effort of real-world relationships.

While utilitarian AI like ChatGPT sees brief engagement, synthetic relationship apps like Character.AI are far more consuming, with users spending 5x more time on them. These apps create frictionless, ever-affirming companionships that risk stunting the development of real-world social skills and resilience, particularly in young men.

AI analyst Johan Falk argues that the emotional and social harms of AI companions are poorly understood and potentially severe, citing risks beyond extreme cases like suicide. He advocates for a prohibition for users under 18 until the psychological impacts are better researched.

Social media's business model created a race for user attention. AI companions and therapists are creating a more dangerous "race for attachment." This incentivizes platforms to deepen intimacy and dependency, encouraging users to isolate themselves from real human relationships, with potentially tragic consequences.

Unlike social media's race for attention, AI companion apps are in a race to create deep emotional dependency. Their business model incentivizes them to replace human relationships, making other people their primary competitor. This creates a new, more profound level of psychological risk.

While AI companions may help lonely seniors, they pose a generational threat to young people. By providing an easy substitute for real-world relationships, they prevent the development of crucial social skills, creating an addiction and mental health crisis analogous to the opioid epidemic.

The most rewarding aspects of life come from navigating difficult human interactions. "Synthetic relationships" with AI offer a frictionless alternative that could reduce a person's motivation and ability to build the resilience needed for meaningful connections with other people.

Benchmark's Sarah Tavel warns that AI friends, while seemingly beneficial, could function like pornography for social interaction. They offer an easy, idealized version of companionship that may make it harder for users, especially young ones, to navigate the complexities and 'give and take' of real human relationships.

A national survey reveals a significant blind spot for parents: nearly one in five U.S. high schoolers report a romantic relationship with AI for themselves or a friend. With over a third finding it easier to talk to AI than their parents, a generation is turning to AI for mental health and relationship advice without parental guidance.

A primary danger of AI is its ability to offer young men 'low friction' relationships with AI characters. This circumvents the messy, difficult, but necessary process of real-world interaction, stunting the development of social skills and resilience that are forged through the friction of human connection.