While GPUs dominate AI hardware discussions, the proliferation of AI agents is causing a significant, often overlooked, CPU shortage. Agents rely on CPUs for web queries, data processing, and other tasks needed to feed GPUs, straining existing infrastructure and driving new demand for companies like Arm and Intel.

Despite strong macro demand for server CPUs driven by AI, Intel's disappointing revenue guidance points to internal execution and production issues. This raises questions about its ability to capitalize on the market boom, as demand outstrips its constrained supply.

AI's evolution from training-heavy (GPU-dominant) to inference- and agent-heavy (CPU-intensive) workflows could invert the traditional data center chip ratio. This represents a seismic shift, creating a massive tailwind for CPU manufacturers like Intel.

While GPUs train models, CPUs are essential for two key workloads: running reinforcement learning environments and executing the code generated by AI. This has created a massive, often overlooked demand spike, making CPUs a critical, sold-out component in the AI infrastructure stack and a hidden bottleneck.

The focus on GPUs for AI overlooks a critical bottleneck: CPU shortages. AI agents require massive CPU power for non-GPU tasks like web queries and data prep. This demand is straining existing infrastructure and creating new market opportunities for CPU makers like ARM.

The era of dual-purpose AI chips is ending. The overwhelming demand for real-time processing from AI agents is forcing companies like Google and NVIDIA to create dedicated, inference-optimized hardware. This marks a fundamental and permanent split in the AI infrastructure market, separating training from inference.

The focus on GPUs for AI overlooks a critical bottleneck: a growing CPU shortage. AI agents rely heavily on CPUs for orchestration tasks like tool calls, database queries, and web searches. This hidden demand is causing hyperscalers to lock in multi-year CPU supply contracts.

The inference market is too large to remain monolithic. It will fragment into specialized platforms for different use cases like real-time video, long-running agents, or language models. This specialization will extend to hardware, with high-throughput, low-latency-need tasks (like agents) favoring cheaper AMD/Intel chips over NVIDIA's top GPUs.

SiFive's Krste Asanović highlights that while GPUs are the focus of the AI boom, the CPUs that feed them data are a critical bottleneck. As AI accelerates tasks like coding by 30x, the corresponding CPU-bound tasks like compiling also need a 30x speedup, driving demand for specialized CPU IP.