Get your free personalized podcast brief
We scan new podcasts and send you the top 5 insights daily.
Companies wanting to keep sensitive research data on-site are discovering a major infrastructure challenge. Even a small, local data center can double a lab facility's total power consumption, a critical and costly factor that must be planned for well in advance of securing space.
Related Insights
The power consumption of AI data centers has ballooned from megawatts to gigawatts. Arista's CEO asserts that securing this level of power is a multi-year challenge, making it a larger and more immediate constraint on AI growth than the development of networking or compute technology itself.
The primary bottleneck for scaling AI over the next decade may be the difficulty of bringing gigawatt-scale power online to support data centers. Smart money is already focused on this challenge, which is more complex than silicon supply.
The massive energy consumption of AI data centers is causing electricity demand to spike for the first time in 70 years, a surge comparable to the widespread adoption of air conditioning. This is forcing tech giants to adopt a "Bring Your Own Power" (BYOP) policy, essentially turning them into energy producers.
The International Energy Agency projects global data center electricity use will reach 945 TWH by 2030. This staggering figure is almost twice the current annual consumption of an industrialized nation like Germany, highlighting an unprecedented energy demand from a single tech sector and making energy the primary bottleneck for AI growth.
Despite staggering announcements for new AI data centers, a primary limiting factor will be the availability of electrical power. The current growth curve of the power infrastructure cannot support all the announced plans, creating a physical bottleneck that will likely lead to project failures and investment "carnage."
Contrary to the common focus on chip manufacturing, the immediate bottleneck for building new AI data centers is energy. Factors like power availability, grid interconnects, and high-voltage equipment are the true constraints, forcing companies to explore solutions like on-site power generation.
The limiting factor for large-scale AI compute is no longer physical space but the availability of electrical power. As a result, the industry now sizes and discusses data center capacity and deals in terms of megawatts, reflecting the primary constraint on growth.
The public power grid cannot support the massive energy needs of AI data centers. This will force a shift toward on-site, "behind-the-meter" power generation, likely using natural gas, where data centers generate their own power and only "sip" from the grid during off-peak times.
Most of the world's energy capacity build-out over the next decade was planned using old models, completely omitting the exponential power demands of AI. This creates a looming, unpriced-in bottleneck for AI infrastructure development that will require significant new investment and planning.
The infrastructure demands of AI have caused an exponential increase in data center scale. Two years ago, a 1-megawatt facility was considered a good size. Today, a large AI data center is a 1-gigawatt facility—a 1000-fold increase. This rapid escalation underscores the immense and expensive capital investment required to power AI.
