The industry is fixated on the GPU shortage, but the proliferation of AI agents will create massive demand for general-purpose compute, leading to a CPU bottleneck. As millions of agents perform tasks, the availability of CPU cores—not just specialized processors—will become the primary constraint on growth for compute providers.

While GPUs dominate AI hardware discussions, the proliferation of AI agents is causing a significant, often overlooked, CPU shortage. Agents rely on CPUs for web queries, data processing, and other tasks needed to feed GPUs, straining existing infrastructure and driving new demand for companies like Arm and Intel.

Cloudflare's CEO illustrates the massive computational overhead of AI agents. He calculates that running agents in traditional containers is unsustainable, necessitating a shift to more efficient architectures like 'isolates' to power the agent-driven future.

The AI boom's focus on GPUs has obscured a growing, non-obvious shortage in older CPU technology. The proliferation of 'agentic workloads' is creating significant new demand for CPUs, forcing major cloud providers like AWS to ask internal engineers to limit waste and manage capacity constraints.

Matthew Prince quantifies the staggering compute demand of AI agents. If every US knowledge worker had just one agent running in a traditional cloud container, it would require half of the world's total CPU production, highlighting the need for more efficient architectures like isolates.

While GPUs train models, CPUs are essential for two key workloads: running reinforcement learning environments and executing the code generated by AI. This has created a massive, often overlooked demand spike, making CPUs a critical, sold-out component in the AI infrastructure stack and a hidden bottleneck.

The focus on GPUs for AI overlooks a critical bottleneck: CPU shortages. AI agents require massive CPU power for non-GPU tasks like web queries and data prep. This demand is straining existing infrastructure and creating new market opportunities for CPU makers like ARM.

While GPUs are key for model training, the next AI wave of autonomous agents relies more on CPUs. The task of controlling and orchestrating multiple agents and tool calls is fundamentally a CPU-based process. This is creating a new hardware bottleneck and shifting focus to CPU manufacturers.

The focus on GPUs for AI overlooks a critical bottleneck: a growing CPU shortage. AI agents rely heavily on CPUs for orchestration tasks like tool calls, database queries, and web searches. This hidden demand is causing hyperscalers to lock in multi-year CPU supply contracts.