While focus is on massive supercomputers for training next-gen models, the real supply chain constraint will be 'inference' chips—the GPUs needed to run models for billions of users. As adoption goes mainstream, demand for everyday AI use will far outstrip the supply of available hardware.

The plateauing performance-per-watt of GPUs suggests that simply scaling current matrix multiplication-heavy architectures is unsustainable. This hardware limitation may necessitate research into new computational primitives and neural network designs built for large-scale distributed systems, not single devices.

The focus in AI has evolved from rapid software capability gains to the physical constraints of its adoption. The demand for compute power is expected to significantly outstrip supply, making infrastructure—not algorithms—the defining bottleneck for future growth.

While NVIDIA's GPUs have been the primary AI constraint, the bottleneck is now moving to other essential subsystems. Memory, networking interconnects, and power management are emerging as the next critical choke points, signaling a new wave of investment opportunities in the hardware stack beyond core compute.

The critical constraint on AI and future computing is not energy consumption but access to leading-edge semiconductor fabrication capacity. With data centers already consuming over 50% of advanced fab output, consumer hardware like gaming PCs will be priced out, accelerating a fundamental shift where personal devices become mere terminals for cloud-based workloads.

The current AI infrastructure expansion differs critically from the dot-com bubble's fiber buildout. There are no 'dark GPUs'; every unit of computing power, even older generations, is immediately utilized, suggesting demand is keeping pace with supply.

While the world focused on GPU shortages, the real constraint on AI compute is now physical infrastructure. The bottleneck has moved to accessing power, building data centers, and finding specialized labor like electricians and acquiring basic materials like structural steel. Merely acquiring chips is no longer enough to scale.

While GPUs dominated headlines, the most significant bottleneck in scaling AI data centers was 100-year-old power transformer technology. With lead times stretching over three years and costs surging 150%, connecting new data centers to the grid became the primary constraint on the AI buildout.

According to Crusoe CEO Chase Lochmiller, the physical supply of semiconductor chips is no longer the primary constraint for AI development. The true bottleneck is the ability to power and house these chips in sufficient data center capacity, making energy and physical infrastructure the most critical factors for scaling AI.