Firms like OpenAI and Meta claim a compute shortage while also exploring selling compute capacity. This isn't a contradiction but a strategic evolution. They are buying all available supply to secure their own needs and then arbitraging the excess, effectively becoming smaller-scale cloud providers for AI.

While focus is on massive supercomputers for training next-gen models, the real supply chain constraint will be 'inference' chips—the GPUs needed to run models for billions of users. As adoption goes mainstream, demand for everyday AI use will far outstrip the supply of available hardware.

Unlike traditional software, OpenAI's growth is limited by a zero-sum resource: GPUs. This physical constraint creates a constant, painful trade-off between serving existing users, launching new features, and funding research, making GPU allocation a central strategic challenge.

The focus in AI has evolved from rapid software capability gains to the physical constraints of its adoption. The demand for compute power is expected to significantly outstrip supply, making infrastructure—not algorithms—the defining bottleneck for future growth.

AI labs like Anthropic that were conservative in securing long-term compute now face a 'quality tax.' They must resort to lower-quality providers or pay significant markups and revenue-sharing deals for last-minute capacity, a cost their more aggressive competitors like OpenAI avoided by signing deals early.

For capital-intensive AI companies like Meta, layoffs are driven by a new financial reality: the need to reallocate massive budgets from employee salaries to compute infrastructure. The enormous cost of GPUs means companies literally cannot afford both a large workforce and the necessary AI hardware.

A critical, under-discussed constraint on Chinese AI progress is the compute bottleneck caused by inference. Their massive user base consumes available GPU capacity serving requests, leaving little compute for the R&D and training needed to innovate and improve their models.

While the growth of new consumer AI users is slowing into an S-curve, the compute consumption per user is still growing exponentially. This is driven by the shift from simple queries to complex, token-intensive tasks like reasoning and agents, sustaining massive demand for GPU infrastructure.

Despite a $380 billion valuation, Anthropic's CEO admits that a single year of overinvesting in compute could lead to bankruptcy. This capital-intensive fragility is a significant, underpriced risk not present in traditional software giants at a similar scale.