AI labs profit from token generation, creating a "big token" economy that conflicts with enterprise budgets. The solution is to use a portfolio of models—large ones for complex tasks and smaller, cheaper ones for simple edits—to optimize the cost-performance ratio.

The most sophisticated AI users aren't locking into one provider. Faced with a 13x annual increase in token costs, they leverage multiple models and routing platforms like OpenRouter to optimize for price and performance. This behavior suggests a future of model commoditization, not monopoly.

To manage AI costs effectively, companies should avoid simply capping token usage, as this kills innovation. A better strategy is to build intelligent routers that assess a task's complexity and dynamically route it to the most appropriate model—powerful models for hard tasks, cheaper ones for simple tasks.

Instead of relying on a single large AI model, companies are adopting "model orchestration" to control costs. This involves using a router to send prompts to the most appropriate model based on the task, often cascading from cheap, small models to more expensive ones only when necessary.

In response to budget blowouts from agentic AI, enterprises are moving beyond simple adoption to active cost management. A new "token efficiency" stack is emerging, featuring tactics like model routing to cheaper alternatives (e.g., DeepSeek) and custom post-trained models to reduce reliance on expensive foundation models.

As enterprises scale AI, the high inference costs of frontier models become prohibitive. The strategic trend is to use large models for novel tasks, then shift 90% of recurring, common workloads to specialized, cost-effective Small Language Models (SLMs). This architectural shift dramatically improves both speed and cost.

Large customers are aggressively optimizing AI spend by abandoning a one-size-fits-all frontier model approach. One software provider is saving nearly $700,000 annually by switching to a much cheaper OpenAI model for a high-volume task, signaling a market-wide shift towards cost-efficiency and model routing.

The hedge fund Citadel Securities observes that the AI market is splitting. After initial enthusiasm, companies are now facing the reality of high token costs and compute constraints, causing a shift away from expensive frontier models toward simpler, more cost-effective AI that offers clearer ROI.

Concerns over profit margins are pushing businesses to explore cost-effective AI. This includes using smaller models from giants like OpenAI and Anthropic (e.g., GPT-mini, Haiku), open-source options, or developing in-house models, rather than exclusively relying on the most powerful, expensive versions.