Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Sarah Friar notes that the top 10% of frontier companies consume eight times more agentic tokens than average firms, up from twice as many months earlier. OpenAI itself consumes 33 times what frontier firms use, signaling that leading organizations are rapidly widening the operational gap by deploying proactive AI coworkers.

Related Insights

The shift from human-in-the-loop AI use to autonomous agents is causing an explosion in API calls. An agent can hit an API over 100 times a day for a single task, compared to a human's 10, leading to a 3000% increase in token consumption and massive revenue growth for AI providers.

Contrary to expectations of falling AI costs, the move from simple chatbots to complex, multi-step agentic systems is causing an explosion in token usage. A single user can trigger hundreds of agents, making expensive frontier models economically unsustainable for many application-layer companies.

Contrary to the view that AI token intensity will drop after the initial coding boom, the move from simple queries to autonomous 'agentic' workflows will cause an order-of-magnitude (10x) increase in token usage per task. This applies across all knowledge-based jobs, ensuring sustained and explosive demand for compute.

The disparity between advanced and average enterprise AI users has tripled in six months. This is driven by 'frontier firms' shifting from simple AI assistance to delegating complex tasks to AI agents, creating a compounding productivity advantage that leaves average users further behind.

Moving from simple chatbots to autonomous agents creates a massive cost increase. Agents consume 5 to 30 times more tokens because they operate in loops, with each task involving 10-20 separate model calls that carry extensive history, instructions, and tool definitions, rapidly compounding costs.

While early generative AI costs were negligible, the shift to complex, multi-step agentic workflows is causing a massive spike in token usage. This has elevated cost optimization and ROI from a minor concern to a C-suite priority for the first time.

The next wave of AI adoption involves 'agentic' workflows, where AI performs complex tasks autonomously. This shift from simple queries to agentic use is expected to increase token consumption by approximately 10x per task. This will drive a massive explosion in compute demand across all knowledge-work industries, not just coding.

Despite fears of runaway costs from "token maxing," enterprises are overwhelmingly encouraging more AI model consumption. A developer survey found 7x more companies were told to increase spending. The value gained from experimenting on AI's rapidly expanding capability frontier currently outweighs the push for cost optimization.

Illustrating a dramatic shift in operational expenses, AI company Mercor now spends more on API tokens for its internal agents than on employee salaries. This is a leading indicator for how most enterprises will operate within five years, where compute costs will eclipse human capital costs.

A forward-looking business metric is emerging where capital allocation shifts from human labor to AI agent labor, measured in 'token spend.' Some tech-forward companies already have token budgets 20-50% higher than their human payrolls, signaling a fundamental change in how businesses will operate and measure productivity.