Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Startups using large AI models shouldn't just worry about their data being used for training. The subtle risk is the *metadata*—like the frequency and type of tool calls—which can reveal a startup's growth, strategy, and product direction to the model provider.

Related Insights

By building a feature that competes directly with startups using its own API, Anthropic demonstrates the "platform risk" inherent in the AI ecosystem. Like Amazon with its Basics line, foundation model companies can observe usage, identify valuable applications, and integrate them, creating a kill-zone for dependent companies.

Developers using OpenAI's API are warned that Sam Altman will analyze their usage data to identify and build competing features. This follows the classic playbook of platform owners like Microsoft and Facebook who studied third-party developers to absorb the most valuable use cases.

Startups building on OpenAI or Anthropic APIs face a major platform risk. Their usage data trains the underlying foundational models, enabling the platform owners to eventually absorb their features natively and make the startups obsolete.

Beyond data privacy, enterprises are concerned that AI agents powered by frontier models will absorb their institutional knowledge. This creates a risky operational dependence where core business learnings are owned and controlled by an external AI company, not the enterprise itself.

Enterprise SaaS companies (the 'henhouse') should be cautious when partnering with foundation model providers (the 'fox'). While offering powerful features, these models have a core incentive to consume proprietary data for training, potentially compromising customer trust, data privacy, and the incumbent's long-term competitive moat.

A vertical AI startup is extremely vulnerable if its core offering can be easily replicated by the foundational model it's built upon. True defensibility comes from integrating unique, proprietary data sources or solving non-obvious workflow problems that the base model cannot simply be prompted to do.

Startups building on proprietary AI platforms like Anthropic or OpenAI face significant risk. The platform can analyze token usage, identify successful applications, and then launch a competing, integrated feature, as Anthropic did to its partner Cursor with Claude Code.

API providers like Anthropic struggle to differentiate between users distilling models for competitive purposes and those conducting large-scale evaluations. Both activities generate similar high-volume, repetitive API calls, creating a detection challenge that also raises user privacy concerns.

For enterprises, the raw capability of foundation models is a security risk, not a selling point. The real product value lies in building "boundaries"—robust permissions, approvals, and audit logs that make powerful models safe to deploy company-wide.

While public discourse on AI safety focuses on existential risk, for enterprises, safety means protecting proprietary knowledge ("alpha"). True enterprise AI safety is achieved by owning the compute, models, and data stack, preventing model providers from stealing trade secrets and customer data.