Flat-rate AI plans are becoming economically unviable due to token-hungry agents. Companies like Google and Microsoft are pushing usage-based billing, forcing enterprises to confront the surprisingly high real cost of running models at scale, which was previously hidden by subsidized pricing experiments.

Contrary to the belief that enterprises have unlimited budgets, they are focused on the ROI of their AI spend. As agentic workflows cause token bills to skyrocket, orchestration tools that intelligently route queries to the most cost-effective model for a given task are becoming essential infrastructure.

The AI market has cleared its first ROI hurdle: model revenue has justified massive infrastructure investment. Now it faces a second, harder test. Enterprises spending billions on AI tokens must demonstrate tangible financial benefits, like higher margins or revenue, to sustain the flywheel.

The most heated topic among Fortune 500 CIOs is no longer which AI model is most powerful, but how to manage unpredictable and soaring token costs. Companies are struggling to find the right strategies—from workload prioritization to user-based access tiers—to create a predictable cost model in a rapidly evolving tech landscape.

According to Mike Cannon-Brookes, advanced enterprises are not tracking AI success by counting tokens. Instead, they are asking harder questions about overall output, such as engineering productivity and quality. They understand that high token usage doesn't always correlate with high productivity, shifting focus from raw usage to tangible business outcomes.

Paralleling the cloud adoption curve, the current surge in AI spending will inevitably be followed by an 'optimization point.' Enterprises will shift from experimentation to efficiency, scrutinizing token usage and seeking to reduce costs, forcing AI providers to help them optimize.

AI companies are pivoting from simply building more powerful models to creating downstream applications. This shift is driven by the fact that enterprises, despite investing heavily in AI promises, have largely failed to see financial returns. The focus is now on customized, problem-first solutions to deliver tangible value.

The current era of broad enterprise AI experimentation will end. The CEO foresees 2026 as a "year of rationalization," where CFO pressure will force companies to consolidate AI tools and cut vendors that fail to demonstrate tangible productivity gains and clear return on investment.

The initial explosion in AI spending was largely additive, not a replacement for existing budgets. Going forward, this will change. Companies will start substituting AI spend for traditional SaaS licenses and human capital as they rationalize operating expenses and seek higher ROI.