Enterprise SaaS companies (the 'henhouse') should be cautious when partnering with foundation model providers (the 'fox'). While offering powerful features, these models have a core incentive to consume proprietary data for training, potentially compromising customer trust, data privacy, and the incumbent's long-term competitive moat.

Related Insights

In an era of opaque AI models, traditional contractual lock-ins are failing. The new retention moat is trust, which requires radical transparency about data sources, AI methodologies, and performance limitations. Customers will not pay long-term for "black box" risks they cannot understand or mitigate.

The notion of building a business as a 'thin wrapper' around a foundational model like GPT is flawed. Truly defensible AI products, like Cursor, build numerous specific, fine-tuned models to deeply understand a user's domain. This creates a data and performance moat that a generic model cannot easily replicate, much like Salesforce was more than just a 'thin wrapper' on a database.

A key disincentive for open-sourcing frontier AI models is that the released model weights contain residual information about the training process. Competitors could potentially reverse-engineer the training data set or proprietary algorithms, eroding the creator's competitive advantage.

The key for enterprises isn't integrating general AI like ChatGPT but creating "proprietary intelligence." This involves fine-tuning smaller, custom models on their unique internal data and workflows, creating a competitive moat that off-the-shelf solutions cannot replicate.

The AI revolution may favor incumbents, not just startups. Large companies possess vast, proprietary datasets. If they quickly fine-tune custom LLMs with this data, they can build a formidable competitive moat that an AI startup, starting from scratch, cannot easily replicate.

As AI makes building software features trivial, the sustainable competitive advantage shifts to data. A true data moat uses proprietary customer interaction data to train AI models, creating a feedback loop that continuously improves the product faster than competitors.

AI models are becoming commodities; the real, defensible value lies in proprietary data and user context. The correct strategy is for companies to use LLMs to enhance their existing business and data, rather than selling their valuable context to model providers for pennies on the dollar.

If a company and its competitor both ask a generic LLM for strategy, they'll get the same answer, erasing any edge. The only way to generate unique, defensible strategies is by building evolving models trained on a company's own private data.

Companies are becoming wary of feeding their unique data and customer queries into third-party LLMs like ChatGPT. The fear is that this trains a potential future competitor. The trend will shift towards running private, open-source models on their own cloud instances to maintain a competitive moat and ensure data privacy.

The concept of "sovereignty" is evolving from data location to model ownership. A company's ultimate competitive moat will be its proprietary foundation model, which embeds tacit knowledge and institutional memory, making the firm more efficient than the open market.

Enterprise Software Incumbents Must Treat Foundation Models as Foxes in the Henhouse | RiffOn