While the cost-per-token is decreasing as models become more efficient, this efficiency gain drives a massive increase in new use cases and overall consumption. This economic principle, Jevons Paradox, explains why total enterprise spending on model inference is skyrocketing, even as the unit cost falls.

While the unit cost of AI inference has plummeted 50x, overall spending on AI is surging. This is a textbook example of Jevons paradox, where radical efficiency gains lead to increased consumption and higher total expenditure as new applications become economically viable.

While the cost per AI query drops, companies find more complex, compute-intensive uses for it. This elasticity of demand means total AI spending becomes a significant and variable operational expense, similar to a utility bill, rather than a predictable software cost.

The comparison of the AI hardware buildout to the dot-com "dark fiber" bubble is flawed because there are no "dark GPUs"—all compute is being used. As hardware efficiency improves and token costs fall (Jevons paradox), it will unlock countless new AI applications, ensuring that demand continues to absorb all available supply.

Despite enterprises hitting AI budget limits, the market is not collapsing. Competition is forcing AI providers to lower token prices, triggering the Jevons paradox: as a resource's cost falls, its consumption increases, sustaining demand for underlying infrastructure like NVIDIA chips.

While the per-unit cost of using AI has plummeted, total enterprise spending has soared. This is a classic example of the Jevons paradox: efficiency gains and lower prices are unlocking entirely new use cases that were previously uneconomical, leading to a net increase in overall consumption and total expenditure.

Jevons Paradox states that as a resource becomes more efficient, consumption increases. Applied to AI, making software development faster won't eliminate developer jobs. Instead, it will create a surge in demand by enabling new applications like internal tools and personal apps.

The common goal of increasing AI model efficiency could have a paradoxical outcome. If AI performance becomes radically cheaper ("too cheap to meter"), it could devalue the massive investments in compute and data center infrastructure, creating a financial crisis for the very companies that enabled the boom.

Efficiency gains in new chips like NVIDIA's H200 don't lower overall energy use. Instead, developers leverage the added performance to build larger, more complex models. This "ambition creep" negates chip-level savings by increasing training times and data movement, ultimately driving total system power consumption higher.