The path to a competitive open-source AI ecosystem is blocked by a massive capital moat. The cost of a single gigawatt-scale data center has exploded to $100 billion, making it virtually impossible for anyone outside of big tech or nation-states to fund the necessary compute.

Glean's co-founder argues that most enterprise tasks don't require expensive frontier models. Open-source alternatives are now capable enough for the vast majority of use cases. The primary adoption driver has shifted from data privacy to pure cost savings, as enterprises seek to control skyrocketing AI bills.

Unlike traditional SaaS, achieving product-market fit in AI is not enough for survival. The high and variable costs of model inference mean that as usage grows, companies can scale directly into unprofitability. This makes developing cost-efficient infrastructure a critical moat and survival strategy, not just an optimization.

The era of using the most powerful AI model for every task is ending. Companies are now focused on the trade-off between quality, cost, and latency. The key question is no longer "Which model is best?" but "Which model is good enough for this task at the lowest price point?"

For typical enterprise tasks like code migration, using an optimized control plane with an open-source model can be over 16 times cheaper than using a frontier model like Claude Opus. While it may be slower, the massive cost savings make it a compelling business alternative.

Companies are discovering they're overpaying for AI by using powerful models for mundane tasks. They will increasingly adopt routers that intelligently direct queries to the most cost-effective model. This move will drive down costs and commoditize the AI model layer.

As AI token consumption becomes a major budget item, companies are moving beyond using a single frontier model. Every organization will need a portfolio of models, including cheaper options for less complex tasks, to manage the "madness" of runaway costs.

Large customers are aggressively optimizing AI spend by abandoning a one-size-fits-all frontier model approach. One software provider is saving nearly $700,000 annually by switching to a much cheaper OpenAI model for a high-volume task, signaling a market-wide shift towards cost-efficiency and model routing.

Using ZAI's GLM 5.2 isn't automatically cheaper than top APIs. It often generates a higher volume of output tokens, increasing costs and wait times. Furthermore, self-hosting requires a massive hardware investment, dispelling the myth that 'open-weight' means 'low-cost'.