Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Today's AI computing demand from millions of human users is just the beginning. The real explosion in demand will come from billions of AI "agents" working 24/7. This will double the workforce and create a relentless, round-the-clock need for inference computing, dwarfing current infrastructure requirements.

Related Insights

Unlike human-driven growth, which is limited by population and waking hours, AI agents can operate, replicate, and call each other endlessly. This creates a potentially infinite demand for compute infrastructure, far exceeding previous models and leading to massive, unpredictable strains on providers.

Individuals will soon manage hundreds or thousands of personal AI agents running concurrently. This shift from owning 3-4 physical devices to countless virtual agents will cause a tenfold explosion in an individual's demand for underlying compute, memory, and power resources, reshaping infrastructure needs.

The shift from simple chatbots (one user request, one API call) to agentic AI systems will decouple inference requests from direct user actions. A single user request could trigger hundreds or thousands of automated model calls, leading to an exponential increase in compute demand and cost.

The current AI data center arms race isn't about meeting today's demand for chatbots. It's fueled by companies like Meta betting on a future where personal AI agents run constantly, analyzing every interaction. This vision of persistent, parallel agents requires an exponential increase in compute, explaining why they will buy any available capacity.

The shift from simple query-based AI to agentic AI, where AI calls itself recursively to solve complex tasks, increases compute demand by orders of magnitude. Most people, especially non-coders, fail to grasp this exponential shift, leading them to consistently underestimate the scale and duration of the AI infrastructure build-out.

Previously, the biggest constraint in AI was compute for training next-gen models. Now, the critical bottleneck is providing enough compute for *inference*—the real-time processing of queries from a rapidly growing user base.

The next wave of AI adoption involves 'agentic' workflows, where AI performs complex tasks autonomously. This shift from simple queries to agentic use is expected to increase token consumption by approximately 10x per task. This will drive a massive explosion in compute demand across all knowledge-work industries, not just coding.

The largest driver of future energy consumption for AI won't be human-initiated queries on chatbots. Instead, it will be the massive, continuous "machine-to-machine" traffic generated by autonomous AI agents performing tasks, which will ultimately swamp human-AI interaction and create a runaway demand for compute power.

The transition from chatbots to autonomous 'agentic' AI represents a fundamental step-change. These agents, which execute complex tasks independently, have already increased the demand for computational power by 1000x, creating a massive, ongoing need for new infrastructure and hardware.

The success of personal AI assistants signals a massive shift in compute usage. While training models is resource-intensive, the next 10x in demand will come from widespread, continuous inference as millions of users run these agents. This effectively means consumers are buying fractions of datacenter GPUs like the GB200.