History shows that major technological shifts like the internet and AI require a fundamental re-architecting of everything from silicon and networking up to software. The industry repeatedly forgets this lesson, mistakenly declaring parts of the stack, like hardware, as commoditized right before the next wave hits.
Related Insights
The tech business model has fundamentally changed. It has moved from the early Google model—a high-margin, low-CapEx "infinite money glitch"—to the current AI paradigm, which requires a capital-intensive, debt-financed infrastructure buildout resembling heavy industries like oil and gas.
The Rubin family of chips is sold as a complete "system as a rack," meaning customers can't just swap out old GPUs. This technical requirement creates a forced, expensive upgrade cycle for cloud providers, compelling them to invest heavily in entirely new rack systems to stay competitive.
The AI era is not an unprecedented bubble but the next phase in a recurring pattern where each new computing cycle (mainframe, PC, internet) is roughly 10 times larger than the last. This historical context suggests the current massive investment is proportional and we are still in the early innings.
When a new technology stack like AI emerges, the infrastructure layer (chips, networking) inflects first and has the most identifiable winners. Sacerdote argues the application and model layers are riskier and less predictable, similar to the early, chaotic days of internet search engines before Google's dominance.
Hyperscalers face a strategic challenge: building massive data centers with current chips (e.g., H100) risks rapid depreciation as far more efficient chips (e.g., GB200) are imminent. This creates a 'pause' as they balance fulfilling current demand against future-proofing their costly infrastructure.
Unlike the dot-com bubble's finite need for fiber optic cables, the demand for AI is infinite because it's about solving an endless stream of problems. This suggests the current infrastructure spending cycle is fundamentally different and more sustainable than previous tech booms.
During a technology shift like AI, if the trend proves real, companies that failed to invest risk being permanently left behind. This forces giants like Microsoft and Meta into unprecedented infrastructure spending as a defensive necessity.
Consumer innovation arrives in predictable waves after major technological shifts. The browser created Amazon and eBay; mobile created Uber and Instagram. The current AI platform shift is creating the same conditions for a new, massive wave of consumer technology companies.
Unlike railroads or telecom, where infrastructure lasts for decades, the core of AI infrastructure—semiconductor chips—becomes obsolete every 3-4 years. This creates a cycle of massive, recurring capital expenditure to maintain data centers, fundamentally changing the long-term ROI calculation for the AI arms race.
The current 2-3 year chip design cycle is a major bottleneck for AI progress, as hardware is always chasing outdated software needs. By using AI to slash this timeline, companies can enable a massive expansion of custom chips, optimizing performance for many at-scale software workloads.
