Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

With memory and components scarce, Jassy says Amazon could theoretically favor AI labs willing to pay more. Instead, he says AWS won't squeeze customers running their businesses on core services; it will help them scale while adding as much capacity as possible for AI demand.

Related Insights

While some neoclouds have 30% to 60% customer revenue concentration with a few frontier labs, AWS caps individual customer allocations at single-digit percentages. Matt Garman explains that AWS actively rations compute across frontier labs, enterprises, and startups. This diversification shields AWS from potential AI industry downturns while ensuring their capacity is backed by real, production-level workloads that demonstrate immediate positive return on investment.

Despite intense competition, Amazon's core principle of being 'customer obsessed' means AWS would likely provide Google's TPU chips if key customers demand them. This prioritizes customer retention over platform exclusivity in the AI chip wars.

Amazon CEO Andy Jassy states that developing custom silicon like Tranium is crucial for AWS's long-term profitability in the AI era. Without it, the company would be "strategically disadvantaged." This frames vertical integration not as an option but as a requirement to control costs and maintain sustainable margins in cloud AI.

An internal AWS document reveals that startups are diverting budgets toward AI models and inference, delaying adoption of traditional cloud services like compute and storage. This suggests AI spend is becoming a substitute for, not an addition to, core infrastructure costs, posing a direct threat to AWS's startup market share.

Amazon's strategy emphasizes infrastructure over proprietary models. By focusing on AWS cloud dominance, custom chips like Trainium, and key partnerships (OpenAI, Anthropic), Amazon is positioning itself as the essential, neutral compute provider for the AI industry, regardless of who builds the winning model.

Despite massive compute demand from frontier AI labs willing to buy out all supply, AWS intentionally reserves GPU and accelerator capacity for early-stage startups. Matt Garman estimates that 30% to 40% of AWS's current revenue comes from companies that began as startups on AWS. Sacrificing short-term lab revenue ensures a healthy ecosystem and guarantees access to the next generation of enterprise customers.

The AI boom's focus on GPUs has obscured a growing, non-obvious shortage in older CPU technology. The proliferation of 'agentic workloads' is creating significant new demand for CPUs, forcing major cloud providers like AWS to ask internal engineers to limit waste and manage capacity constraints.

While AI compute demand seems limitless, its price is not infinitely elastic. As inference becomes a core cost of goods sold (COGS) for AI products, excessively high compute prices will break the business models of infrastructure customers, ultimately limiting demand.

The intense computational demand and latency of AI models are compelling enterprises to use multiple cloud providers. Rather than vendor loyalty, companies now prioritize performance, switching between clouds like AWS and Azure to find the fastest available capacity for their AI workloads, reshaping the cloud market.

AWS CEO Andy Jassy describes current AI adoption as a "barbell": AI labs on one end and enterprises using AI for productivity on the other. He believes the largest future market is the "middle"—enterprises deploying AI in their core production apps. AWS's strategy is to leverage its data gravity to win this massive, untapped segment.

AWS won't squeeze core customers to serve AI labs | RiffOn