Large enterprises like AT&T manage soaring AI costs with a tiered strategy. They aim to use cheaper open-source models for 60-70% of internal tasks, keeping spending on expensive frontier models flat while overall AI usage grows. This treats premium models as specialized tools, not defaults.

Meta's massive internal consumption of AI tokens for tasks like code generation creates a multi-billion dollar expense. By developing its own frontier models in-house, Meta can vertically integrate, justifying the high cost of its AI lab (MSL) purely on internal savings, even before launching any new consumer AI products.

The era of 'token maxing,' where enterprises used AI models without cost constraints, is ending. Companies like Microsoft are now scrutinizing the ROI of their AI spend, leading to budget cuts and a potential deceleration in the hyper-growth seen by model providers.

As part of its 'token minimizing' strategy, Meta is encouraging employees to use its in-house tools like MetaCode over more advanced external models. This creates an awkward trade-off: potentially reducing employee productivity to lower the company's massive AI operational expenditure bill.

Despite being a major cloud partner, Microsoft is actively developing its own frontier AI models to compete with and reduce dependency on third-party labs. AI chief Mustafa Suleiman called Anthropic's models "extremely expensive" and stated the company's goal is to eliminate this cost.

In response to budget blowouts from agentic AI, enterprises are moving beyond simple adoption to active cost management. A new "token efficiency" stack is emerging, featuring tactics like model routing to cheaper alternatives (e.g., DeepSeek) and custom post-trained models to reduce reliance on expensive foundation models.

Large customers are aggressively optimizing AI spend by abandoning a one-size-fits-all frontier model approach. One software provider is saving nearly $700,000 annually by switching to a much cheaper OpenAI model for a high-volume task, signaling a market-wide shift towards cost-efficiency and model routing.

Concerns over profit margins are pushing businesses to explore cost-effective AI. This includes using smaller models from giants like OpenAI and Anthropic (e.g., GPT-mini, Haiku), open-source options, or developing in-house models, rather than exclusively relying on the most powerful, expensive versions.

Microsoft is developing its own AI models from scratch, pitching them as cheaper and more effective for customized enterprise needs than leading models from its partner OpenAI or competitor Anthropic. This signals a strategy to control the full AI stack and compete directly on price.