Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Early AI adoption focused on "token maxing" – feeding massive contexts to models. This proved expensive and ineffective, with high pilot failure rates. The industry is now shifting towards a more surgical approach guided by FDEs who determine precisely where and how to apply AI for maximum ROI.

Related Insights

Intelligence from frontier models is now a commodity. The real value comes from Forward Deployed Engineers (FDEs) who customize and apply this general intelligence to a company's specific, unique workflows, creating a competitive edge through superior deployment.

After initial unrestricted spending led to budget overruns at companies like Uber, major enterprises are shifting focus. They are moving away from measuring raw AI usage (tokens) and toward implementing AI only for proven use cases with clear ROI, which may benefit cheaper, open-source models over expensive frontier ones.

Early enterprise AI adoption mirrored the initial, inefficient use of AWS, with rampant experimentation. Now, companies are maturing, learning to apply AI strategically, much like a savvy Costco shopper who targets specific items instead of wandering every aisle. This shift involves using cheaper or open-source models for simpler tasks and reserving frontier models for high-value problems.

To avoid the common 95% failure rate of AI pilots, companies should use a focused, incremental approach. Instead of a broad rollout, map a single workflow, identify its main bottleneck, and run a short, measured experiment with AI on that step only before expanding.

The initial approach to AI adoption was often "token maxing"—using as many tokens as possible under the assumption that more usage equals more value. A more sophisticated and sustainable strategy is "output maxing," which focuses on achieving the desired result while actively minimizing token consumption and cost.

In response to budget blowouts from agentic AI, enterprises are moving beyond simple adoption to active cost management. A new "token efficiency" stack is emerging, featuring tactics like model routing to cheaper alternatives (e.g., DeepSeek) and custom post-trained models to reduce reliance on expensive foundation models.

As AI token consumption becomes a major budget item, companies are moving beyond using a single frontier model. Every organization will need a portfolio of models, including cheaper options for less complex tasks, to manage the "madness" of runaway costs.

The recent focus on model routers signals a maturation of enterprise AI strategy. The initial "growth at all costs" phase, which encouraged rampant employee use ("token maxing"), is giving way to a new era of cost optimization and demonstrating clear ROI on AI investments.

Companies initially gamified AI use, leading to a "token maxing" culture. Now, facing enormous, unexpected bills, they are experiencing "sticker shock." This is forcing a strategic shift from encouraging maximum usage to demanding ROI calculations and finding the most cost-effective AI model for a given task.

As AI costs rise, using one powerful frontier model for every task is no longer financially viable. The solution is to create a dedicated "Model Sommelier" role responsible for curating a portfolio of models, continuously testing and selecting the most cost-effective option for each specific business use case.