Faced with rising costs from proprietary labs, sophisticated enterprise clients are building internal evaluation and routing systems. This allows them to use cheaper, open-source models for less complex tasks, optimizing for both cost and performance.

After initial unrestricted spending led to budget overruns at companies like Uber, major enterprises are shifting focus. They are moving away from measuring raw AI usage (tokens) and toward implementing AI only for proven use cases with clear ROI, which may benefit cheaper, open-source models over expensive frontier ones.

Early enterprise AI adoption mirrored the initial, inefficient use of AWS, with rampant experimentation. Now, companies are maturing, learning to apply AI strategically, much like a savvy Costco shopper who targets specific items instead of wandering every aisle. This shift involves using cheaper or open-source models for simpler tasks and reserving frontier models for high-value problems.

The AI industry has shifted from a subsidized model to a "token shortage" era. This forces all companies, from AI providers to enterprise users like Uber, to prioritize cost-effective usage. Business models are now usage-based, making architectural and financial efficiency paramount.

To manage AI costs effectively, companies should avoid simply capping token usage, as this kills innovation. A better strategy is to build intelligent routers that assess a task's complexity and dynamically route it to the most appropriate model—powerful models for hard tasks, cheaper ones for simple tasks.

In response to budget blowouts from agentic AI, enterprises are moving beyond simple adoption to active cost management. A new "token efficiency" stack is emerging, featuring tactics like model routing to cheaper alternatives (e.g., DeepSeek) and custom post-trained models to reduce reliance on expensive foundation models.

As AI token consumption becomes a major budget item, companies are moving beyond using a single frontier model. Every organization will need a portfolio of models, including cheaper options for less complex tasks, to manage the "madness" of runaway costs.

The recent focus on model routers signals a maturation of enterprise AI strategy. The initial "growth at all costs" phase, which encouraged rampant employee use ("token maxing"), is giving way to a new era of cost optimization and demonstrating clear ROI on AI investments.

Companies initially gamified AI use, leading to a "token maxing" culture. Now, facing enormous, unexpected bills, they are experiencing "sticker shock." This is forcing a strategic shift from encouraging maximum usage to demanding ROI calculations and finding the most cost-effective AI model for a given task.