For critical enterprise uses like coding, the cost to remediate a single error from a cheaper AI model far outweighs any savings. This high cost of failure ensures businesses will continue paying a premium for more reliable, high-end proprietary models for crucial tasks, while using open-source options for lower-stakes work.

Clay Bavor advises building proprietary frameworks and architectures to create a unique product. However, he warns against the massive, ongoing capital expense of pre-training foundation models, calling them a "highly perishable bag of floating point numbers" that startups should avoid.

Creating frontier AI models is incredibly expensive, yet their value depreciates rapidly as they are quickly copied or replicated by lower-cost open-source alternatives. This forces model providers to evolve into more defensible application companies to survive.

With 80% of revenue tied to token usage, leading model providers are not incentivized to offer features like auto-routing to cheaper models. This business model conflict creates a competitive vulnerability and an opportunity for third-party tools like Cursor to win by optimizing developer experience and cost-efficiency.

Unlike digital ads where ROI is transparent, the value of an LLM's output is hard to quantify. This opacity prevents purely price-based competition, allowing more expensive models to retain customers who cannot easily prove a cheaper alternative is "good enough."

The paradoxical financial state of AI labs: individual models can generate healthy gross margins from inference, but the parent company operates at a loss. This is due to the massive, exponentially increasing R&D costs required to train the next, more powerful model.

Mobile networks built expensive global infrastructure with massive usage but captured little value as profits moved "up the stack" to apps. Foundation models, despite huge CapEx, face a similar risk of becoming a commoditized infrastructure layer with low pricing power.

Despite billions in funding, large AI models face a difficult path to profitability. The immense training cost is undercut by competitors creating similar models for a fraction of the price and, more critically, the ability for others to reverse-engineer and extract the weights from existing models, eroding any competitive moat.

Open source AI models don't need to become the dominant platform to fundamentally alter the market. Their existence alone acts as a powerful price compressor. Proprietary model providers are forced to lower their prices to match the inference cost of open-source alternatives, squeezing profit margins and shifting value to other parts of the stack.