Glean's co-founder argues that most enterprise tasks don't require expensive frontier models. Open-source alternatives are now capable enough for the vast majority of use cases. The primary adoption driver has shifted from data privacy to pure cost savings, as enterprises seek to control skyrocketing AI bills.

The era of using the most powerful AI model for every task is ending. Companies are now focused on the trade-off between quality, cost, and latency. The key question is no longer "Which model is best?" but "Which model is good enough for this task at the lowest price point?"

Instead of relying solely on massive, expensive, general-purpose LLMs, the trend is toward creating smaller, focused models trained on specific business data. These "niche" models are more cost-effective to run, less likely to hallucinate, and far more effective at performing specific, defined tasks for the enterprise.

The "agentic revolution" will be powered by small, specialized models. Businesses and public sector agencies don't need a cloud-based AI that can do 1,000 tasks; they need an on-premise model fine-tuned for 10-20 specific use cases, driven by cost, privacy, and control requirements.

Relying solely on expensive frontier models is unsustainable. Vertical AI companies must build a portfolio of smaller, specialized models that match frontier performance on specific tasks but cost 100x less, effectively allocating intelligence where it's needed most.

As AI token consumption becomes a major budget item, companies are moving beyond using a single frontier model. Every organization will need a portfolio of models, including cheaper options for less complex tasks, to manage the "madness" of runaway costs.

Large customers are aggressively optimizing AI spend by abandoning a one-size-fits-all frontier model approach. One software provider is saving nearly $700,000 annually by switching to a much cheaper OpenAI model for a high-volume task, signaling a market-wide shift towards cost-efficiency and model routing.

Companies like Thinking Machines Lab and Microsoft are shifting the value proposition from raw API access to platforms for enterprise-specific model customization. This addresses corporate needs for data sovereignty, cost control, and specialized performance, creating a new competitive lane focused on enabling customers to own their own models.

Concerns over profit margins are pushing businesses to explore cost-effective AI. This includes using smaller models from giants like OpenAI and Anthropic (e.g., GPT-mini, Haiku), open-source options, or developing in-house models, rather than exclusively relying on the most powerful, expensive versions.