The massive capital expenditure by hyperscalers on AI will likely create an oversupply of capacity. This will crash prices, creating a golden opportunity for a new generation of companies to build innovative applications on cheap AI, much like Amazon utilized the cheap bandwidth left after the dot-com bust.

The cost for a given level of AI capability has decreased by a factor of 100 in just one year. This radical deflation in the price of intelligence requires a complete rethinking of business models and future strategies, as intelligence becomes an abundant, cheap commodity.

Despite enterprises hitting AI budget limits, the market is not collapsing. Competition is forcing AI providers to lower token prices, triggering the Jevons paradox: as a resource's cost falls, its consumption increases, sustaining demand for underlying infrastructure like NVIDIA chips.

The cost of AI, priced in "tokens by the drink," is falling dramatically. All inputs are on a downward cost curve, leading to a hyper-deflationary effect on the price of intelligence. This, in turn, fuels massive demand elasticity as more use cases become economically viable.

The primary short-term risk for the AI sector isn't capital expenditure but the high cost of token generation. For AI applications to become ubiquitous, the unit economics must improve. If running a single query remains prohibitively expensive for businesses, widespread, sustainable adoption will be impossible, threatening the entire investment thesis.

Arvind Krishna forecasts a 1000x drop in AI compute costs over five years. This won't just come from better chips (a 10x gain). It will be compounded by new processor architectures (another 10x) and major software optimizations like model compression and quantization (a final 10x).

Countering the narrative of insurmountable training costs, Jensen Huang argues that architectural, algorithmic, and computing stack innovations are driving down AI costs far faster than Moore's Law. He predicts a billion-fold cost reduction for token generation within a decade.

While cutting-edge AI is extremely expensive, its cost drops dramatically fast. A reasoning benchmark that cost OpenAI $4,500 per question in late 2024 cost only $11 a year later. This steep deflation curve means even the most advanced capabilities quickly become accessible to the mass market.

Current high token prices are a temporary result of compute scarcity and the need for enterprise use to subsidize unprofitable consumer AI. Nikesh Arora believes that as compute capacity increases and consumer models are monetized or constrained, prices will fall to one-tenth of today's levels.