While focus is on massive supercomputers for training next-gen models, the real supply chain constraint will be 'inference' chips—the GPUs needed to run models for billions of users. As adoption goes mainstream, demand for everyday AI use will far outstrip the supply of available hardware.

Unlike traditional software, OpenAI's growth is limited by a zero-sum resource: GPUs. This physical constraint creates a constant, painful trade-off between serving existing users, launching new features, and funding research, making GPU allocation a central strategic challenge.

Greg Brockman states that in AI, 'too much opportunity' is the main problem, as most ideas work. OpenAI's strategic decisions, like focusing on the GPT reasoning model over video generation, are primarily driven by an extreme scarcity of compute. They cannot fund all promising avenues simultaneously.

New AI models are designed to perform well on available, dominant hardware like NVIDIA's GPUs. This creates a self-reinforcing cycle where the incumbent hardware dictates which model architectures succeed, making it difficult for superior but incompatible chip designs to gain traction.

Anthropic is throttling user access during peak hours due to GPU shortages. This confirms that the AI industry remains severely compute-constrained and validates the multi-billion dollar infrastructure investments by giants like OpenAI and Meta, which once seemed excessive.

The relationship between computing power and AI model capability is not linear. According to established 'scaling laws,' a tenfold increase in the compute used for training large language models (LLMs) results in roughly a doubling of the model's capabilities, highlighting the immense resources required for incremental progress.

The focus in AI has evolved from rapid software capability gains to the physical constraints of its adoption. The demand for compute power is expected to significantly outstrip supply, making infrastructure—not algorithms—the defining bottleneck for future growth.

A critical, under-discussed constraint on Chinese AI progress is the compute bottleneck caused by inference. Their massive user base consumes available GPU capacity serving requests, leaving little compute for the R&D and training needed to innovate and improve their models.

According to Stanford's Fei-Fei Li, the central challenge facing academic AI isn't the rise of closed, proprietary models. The more pressing issue is a severe imbalance in resources, particularly compute, which cripples academia's ability to conduct its unique mission of foundational, exploratory research.