The inconsistency and 'laziness' of base LLMs is a major hurdle. The best application-layer companies differentiate themselves not by just wrapping a model, but by building a complex harness that ensures the right amount of intelligence is reliably applied to a specific user task, creating a defensible product.

For long-term defensibility, AI companies must control the entire stack: the model, the middleware, and the end-user work product. While some can start with the model layer, others can successfully start with the user interface and vertically integrate downwards over time to build a durable business.

Anyone can build a simple "hackathon version" of an AI agent. The real, defensible moat comes from the painstaking engineering work to make the agent reliable enough for mission-critical enterprise use cases. This "schlep" of nailing the edge cases is a barrier that many, including big labs, are unmotivated to cross.

In an era of rapid AI-driven development, competitors can easily replicate core functionality. The defensible advantage lies in mastering the complexities they ignore: unhappy paths, audit logging, RBAC, and other enterprise-grade edge cases.

The enduring moat in the AI stack lies in what is hardest to replicate. Since building foundation models is significantly more difficult than building applications on top of them, the model layer is inherently more defensible and will naturally capture more value over time.

With AI development becoming accessible, having an "AI product" is not a sustainable advantage. True defensibility comes from solving a specific customer problem better than anyone else, using AI as a tool, not the core value proposition. The challenge is no longer building, but deciding what to build.

Greg Brockman reveals that OpenAI's core defensibility isn't any single model, which can be imitated. Instead, their strategic advantage is the end-to-end, repeatable system—a combination of people, processes, and infrastructure—that consistently produces next-generation models.

In the AI era, defensibility comes from building a complex system of record, not just a thin wrapper on an LLM. Companies with a 'thick application layer' that offers standalone value are unattractive for model providers to replicate, whereas thin wrappers risk being absorbed by the platform they are built on.

With AI commoditizing code creation, the sustainable value for software companies shifts. Customers pay for reliability, support, compliance, and security patches—the 'never ending maintenance commitment'—which becomes the key differentiator when anyone can build an initial app quickly.