Instead of competing with labs on model training, the defensible strategy is to build the ideal environment or 'habitat' for an LLM in a specific vertical. Replit did this for programming by adapting its editor, cloud infrastructure, and deployment tools to serve the AI, not just the human.
Related Insights
The inconsistency and 'laziness' of base LLMs is a major hurdle. The best application-layer companies differentiate themselves not by just wrapping a model, but by building a complex harness that ensures the right amount of intelligence is reliably applied to a specific user task, creating a defensible product.
Simply offering the latest model is no longer a competitive advantage. True value is created in the system built around the model—the system prompts, tools, and overall scaffolding. This 'harness' is what optimizes a model's performance for specific tasks and delivers a superior user experience.
The notion of building a business as a 'thin wrapper' around a foundational model like GPT is flawed. Truly defensible AI products, like Cursor, build numerous specific, fine-tuned models to deeply understand a user's domain. This creates a data and performance moat that a generic model cannot easily replicate, much like Salesforce was more than just a 'thin wrapper' on a database.
While many new AI tools excel at generating prototypes, a significant gap remains to make them production-ready. The key business opportunity and competitive moat lie in closing this gap—turning a generated concept into a full-stack, on-brand, deployable application. This is the 'last mile' problem.
Since LLMs are commodities, sustainable competitive advantage in AI comes from leveraging proprietary data and unique business processes that competitors cannot replicate. Companies must focus on building AI that understands their specific "secret sauce."
Creating a basic AI coding tool is easy. The defensible moat comes from building a vertically integrated platform with its own backend infrastructure like databases, user management, and integrations. This is extremely difficult for competitors to replicate, especially if they rely on third-party services like Superbase.
The common critique of AI application companies as "GPT wrappers" with no moat is proving false. The best startups are evolving beyond using a single third-party model. They are using dozens of models and, crucially, are backward-integrating to build their own custom AI models optimized for their specific domain.
A key defensibility for Replit is its proprietary, transactional file system that allows for immutable, ledger-based actions. This enables cheap 'forking' of the entire system, allowing them to sample an LLM's output hundreds of times to pick the best result—a hard-to-replicate technical advantage.
In enterprise AI, competitive advantage comes less from the underlying model and more from the surrounding software. Features like versioning, analytics, integrations, and orchestration systems are critical for enterprise adoption and create stickiness that models alone cannot.
Powerful AI products are built with LLMs as a core architectural primitive, not as a retrofitted feature. This "native AI" approach creates a deep technical moat that is difficult for incumbents with legacy architectures to replicate, similar to the on-prem to cloud-native shift.
