Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Despite significant community and political opposition, the underlying demand for AI compute, proxied by token usage, continues to rise. The primary business risk isn't a reduction in demand for AI services, but rather a critical bottleneck in the physical supply of data center capacity.

Related Insights

The demand for AI tokens is growing faster than the supply of GPU infrastructure. This profound imbalance creates a market where not just top-tier AI labs, but also second and third-tier players will likely sell out their capacity. Superior models will command better margins, but the overall resource constraint means even lesser models will find customers.

Specialized AI cloud providers like CoreWeave face a unique business reality where customer demand is robust and assured for the near future. Their primary business challenge and gating factor is not sales or marketing, but their ability to secure the physical supply of high-demand GPUs and other AI chips to service that demand.

The primary bottleneck for scaling AI over the next decade may be the difficulty of bringing gigawatt-scale power online to support data centers. Smart money is already focused on this challenge, which is more complex than silicon supply.

The AI industry's explosive growth has outpaced the physical infrastructure supporting it. Data centers, which follow slow real estate development cycles of permits and construction, could not be built fast enough to meet the sudden, massive demand for compute, creating a global bottleneck.

The focus in AI has evolved from rapid software capability gains to the physical constraints of its adoption. The demand for compute power is expected to significantly outstrip supply, making infrastructure—not algorithms—the defining bottleneck for future growth.

While the world focused on GPU shortages, the real constraint on AI compute is now physical infrastructure. The bottleneck has moved to accessing power, building data centers, and finding specialized labor like electricians and acquiring basic materials like structural steel. Merely acquiring chips is no longer enough to scale.

While the growth of new consumer AI users is slowing into an S-curve, the compute consumption per user is still growing exponentially. This is driven by the shift from simple queries to complex, token-intensive tasks like reasoning and agents, sustaining massive demand for GPU infrastructure.

While chip fabrication is complex, the most binding constraint for AI compute providers is physical infrastructure. The entire industry's growth is bottlenecked by the availability of powered data center buildings, a problem projected to persist for at least another 15-18 months.

While data was once a major constraint for training AI, models can now effectively create their own synthetic data. This has shifted the critical choke points in the AI supply chain to physical infrastructure like power grids and data center construction, which are now the primary limiters of growth.

According to Crusoe CEO Chase Lochmiller, the physical supply of semiconductor chips is no longer the primary constraint for AI development. The true bottleneck is the ability to power and house these chips in sufficient data center capacity, making energy and physical infrastructure the most critical factors for scaling AI.

AI Compute Demand Is Unwavering; Data Center Pushback Is a Supply, Not Demand, Risk | RiffOn