The team managing Composio's AI pipeline for building tool integrations spends more on LLM tokens than on salaries for its engineers. This signals a new economic reality for AI-native companies where compute is a larger operational cost than labor.

The economics for enterprises adopting AI are incredibly favorable. A task costing $55 in human labor can be completed by an LLM for a fraction of the $5 cost of a million tokens. This massive arbitrage creates a powerful incentive for adoption and justifies large-scale infrastructure spending.

While AI agents will be used personally, their high token costs make the return on investment far greater in enterprise settings. An agent's ability to generate output that directly impacts GDP means business use cases will receive development priority over consumer or personal automation.

Howie Lu advises against anchoring AI costs to cheap software subscriptions. Instead, evaluate token costs against the opportunity cost of an equivalent human's time. A $150 agent-written board memo is cheap if it saves days of a CEO's time and produces a superior result.

While the per-unit cost of using AI has plummeted, total enterprise spending has soared. This is a classic example of the Jevons paradox: efficiency gains and lower prices are unlocking entirely new use cases that were previously uneconomical, leading to a net increase in overall consumption and total expenditure.

The cost to achieve a specific performance benchmark dropped from $60 per million tokens with GPT-3 in 2021 to just $0.06 with Llama 3.2-3b in 2024. This dramatic cost reduction makes sophisticated AI economically viable for a wider range of enterprise applications, shifting the focus to on-premise solutions.

Even for complex, multi-hour tasks requiring millions of tokens, current AI agents are at least an order of magnitude cheaper than paying a human with relevant expertise. This significant cost advantage suggests that economic viability will not be a near-term bottleneck for deploying AI on increasingly sophisticated tasks.

While the cost to achieve a fixed capability level (e.g., GPT-4 at launch) has dropped over 100x, overall enterprise spending is increasing. This paradox is explained by powerful multipliers: demand for frontier models, longer reasoning chains, and multi-step agentic workflows that consume exponentially more tokens.

The next wave of AI adoption involves 'agentic' workflows, where AI performs complex tasks autonomously. This shift from simple queries to agentic use is expected to increase token consumption by approximately 10x per task. This will drive a massive explosion in compute demand across all knowledge-work industries, not just coding.