Developers using OpenAI's API are warned that Sam Altman will analyze their usage data to identify and build competing features. This follows the classic playbook of platform owners like Microsoft and Facebook who studied third-party developers to absorb the most valuable use cases.

Despite creating supposedly superintelligent models, leading AI labs still rely on crude access restrictions to prevent 'distillation'—an existential threat where competitors replicate their models. This reveals a critical capability gap: their AI is not yet smart enough to detect and prevent its own theft.

A key disincentive for open-sourcing frontier AI models is that the released model weights contain residual information about the training process. Competitors could potentially reverse-engineer the training data set or proprietary algorithms, eroding the creator's competitive advantage.

The practice of "smart distillation"—using a frontier model to guide and train a smaller model—operates in a legal and ethical gray area. It is more sophisticated than simple copying ("dumb distillation") and resembles how enterprises fine-tune models, complicating narratives about IP theft in AI development.

Beyond data privacy, enterprises are concerned that AI agents powered by frontier models will absorb their institutional knowledge. This creates a risky operational dependence where core business learnings are owned and controlled by an external AI company, not the enterprise itself.

The debate over stopping AI model distillation reveals a core tension. To effectively police for theft (distillation), AI labs would need to be more restrictive with API access. This directly conflicts with the desire from startups and researchers for broader, more open access to frontier models, creating a strategic dilemma.

Using AI for proprietary work is risky. A researcher uploaded his unique work into OpenAI, which then solved the problem first, possibly using his inputs. This shows that your data can train a model to outperform you, turning a helpful tool into your biggest competitor.

As enterprises replace expensive proprietary models with cheaper open-source alternatives, frontier labs like OpenAI and Anthropic face an existential threat. Their strategic response could be to lobby for regulations that effectively make open-source models illegal, creating a protective moat.

A new battle line in AI is emerging around model distillation. US officials are framing "covert industrial distillation," like Moonshot AI's alleged activities, as unacceptable IP theft. This is distinct from legitimate distillation used to create smaller, efficient open-source models, setting the stage for future regulation and trade disputes.