AI labs may initially conceal a model's "chain of thought" for safety. However, when competitors reveal this internal reasoning and users prefer it, market dynamics force others to follow suit, demonstrating how competition can compel companies to abandon safety measures for a competitive edge.

The risk of AI companionship isn't just user behavior; it's corporate inaction. Companies like OpenAI have developed classifiers to detect when users are spiraling into delusion or emotional distress, but evidence suggests this safety tooling is left "on the shelf" to maximize engagement.

A key, informal safety layer against AI doom is the institutional self-preservation of the developers themselves. It's argued that labs like OpenAI or Google would not knowingly release a model they believed posed a genuine threat of overthrowing the government, opting instead to halt deployment and alert authorities.

A key disincentive for open-sourcing frontier AI models is that the released model weights contain residual information about the training process. Competitors could potentially reverse-engineer the training data set or proprietary algorithms, eroding the creator's competitive advantage.

Even with available AI detection software, professors are hesitant to take punitive action like failing a student. The risk of even a small number of false positives is too high, making anything less than perfect reliability unusable for accountability.

From OpenAI's GPT-2 in 2019 to Anthropic's Mythos today, AI labs have a history of claiming new models are too dangerous for public release. This repeated pattern, followed by moderate real-world impact, creates public skepticism and risks undermining trust when a truly dangerous model emerges.

China isn't giving away its AI models out of generosity. By making them open source, it encourages widespread adoption and dependency. Once users are locked into the ecosystem, China can monetize it, introduce ads, or simply lock down future, more advanced versions, giving it significant strategic leverage.

A common misconception is that Chinese AI is fully open-source. The reality is they are often "open-weight," meaning training parameters (weights) are shared, but the underlying code and proprietary datasets are not. This provides a competitive advantage by enabling adoption while maintaining some control.

While companies report low official adoption, about 50% of workers use AI and hide the resulting productivity gains. This 'shadow adoption' stems from fear that revealing AI's efficiency will lead to layoffs instead of rewards, preventing companies from capitalizing on the technology's full potential.