While the cost-per-token is decreasing as models become more efficient, this efficiency gain drives a massive increase in new use cases and overall consumption. This economic principle, Jevons Paradox, explains why total enterprise spending on model inference is skyrocketing, even as the unit cost falls.

For years, flat-rate AI subscriptions heavily subsidized power users, masking the true cost of token consumption. As providers shift to usage-based billing, this subsidy is ending. Enterprises now face "sticker shock" and must justify AI spend with clear ROI, moving from rampant experimentation to cost-conscious implementation.

The widely-circulated chart showing a drop in the "LLM Token Expenditure Index" doesn't reflect a decline in AI demand. It merely shows a drop in the average price paid for tokens, and its data is sourced exclusively from third-party routers designed to find cheaper options, thus skewing the results.

Newer AI models may have low per-token prices but are often "token hungry," requiring more tokens to complete a task. This can make them more expensive overall. The true measure of economic viability is the final cost-per-task, not the misleading per-token price.

The most sophisticated AI users aren't locking into one provider. Faced with a 13x annual increase in token costs, they leverage multiple models and routing platforms like OpenRouter to optimize for price and performance. This behavior suggests a future of model commoditization, not monopoly.

The cost of AI, priced in "tokens by the drink," is falling dramatically. All inputs are on a downward cost curve, leading to a hyper-deflationary effect on the price of intelligence. This, in turn, fuels massive demand elasticity as more use cases become economically viable.

While the cost to achieve a fixed capability level (e.g., GPT-4 at launch) has dropped over 100x, overall enterprise spending is increasing. This paradox is explained by powerful multipliers: demand for frontier models, longer reasoning chains, and multi-step agentic workflows that consume exponentially more tokens.

OpenAI's GPT-5.5 is more expensive per token, but a new evaluation framework is emerging. The key metric isn't raw cost, but the model's efficiency in solving a problem. This 'intelligence per dollar' reframes cost analysis around performance and compute, where more expensive models can be cheaper overall if they solve tasks more efficiently.

A model with a low per-token price can be more expensive if it's inefficient, verbose, or requires multiple attempts ('overthinking'). The actual invoice depends on the total tokens needed to complete a task, making token efficiency a hidden multiplier that savvy enterprises are now tracking to determine the true cost.