While focus is on massive supercomputers for training next-gen models, the real supply chain constraint will be 'inference' chips—the GPUs needed to run models for billions of users. As adoption goes mainstream, demand for everyday AI use will far outstrip the supply of available hardware.

Contrary to the long-term belief that AI will be deflationary, the current surge in demand for computer equipment for data centers is stronger than supply, causing prices to spike and contributing significantly to producer price inflation (PPI).

In a striking economic anomaly, the cost to rent older NVIDIA H100 AI chips is increasing, not decreasing. This is because the growth in AI's usefulness is outstripping the tripling annual supply of compute. It signals that the value being generated by AI models is growing faster than our ability to manufacture the hardware to run them.

As AI models achieve human-level capabilities in valuable roles like software engineering, they can generate significantly more revenue from the same hardware. This increased monetization potential will cause the rental price of GPUs to skyrocket, potentially by over 15x, to match the economic value they produce.

Contrary to expectations of easing supply, the GPU shortage has intensified since 2023. With clearer AI business models, mega-customers like OpenAI and Anthropic are spending even more aggressively, creating a fierce bidding war that pushes startups out.

A counterintuitive view of Moore's Law is that for it to hold, the economic value of computation must halve every 18 months because we historically run out of uses for it. The recent rise in H100 GPU rental costs suggests AI is the first application where demand is growing faster than supply, breaking this trend.

Unlike durable infrastructure like railways or fiber optic cables, AI's core component—expensive GPUs—becomes obsolete in just 2-3 years. This creates a permanent, recurring cost, a 'tax on innovation,' making profitability much harder to achieve compared to previous tech revolutions.

The rental prices for older NVIDIA GPUs, like the Hopper family and A100s, are increasing. This counterintuitive trend shows demand for AI compute is so far outstripping total supply that even previous-generation hardware is becoming more valuable, highlighting the severity of the GPU crunch.

The intense demand for memory chips for AI is causing a shortage so severe that NVIDIA is delaying a new gaming GPU for the first time in 30 years. This demonstrates a major inflection point where the AI industry's hardware needs are creating significant, tangible ripple effects on adjacent, multi-billion dollar consumer markets.