A new category of "NeoCloud" or "AI-native cloud" is rising, focusing specifically on AI training and inference. Unlike general-purpose clouds like AWS, these platforms are GPU-first, catering to massive AI workloads and addressing the GPU scarcity and different workload patterns found in hyperscalers.

In a major shift, OpenAI can now offer its products on any cloud provider, not just exclusively on Microsoft Azure. This change was immediately capitalized on by Amazon, which announced OpenAI models would be available on AWS Bedrock within hours.

Amazon's strategy emphasizes infrastructure over proprietary models. By focusing on AWS cloud dominance, custom chips like Trainium, and key partnerships (OpenAI, Anthropic), Amazon is positioning itself as the essential, neutral compute provider for the AI industry, regardless of who builds the winning model.

The podcast highlights a stunning comparison from Andy Jassy's letter: three years post-launch, AWS had a $58 million run rate. In a similar timeframe for the AI wave, AWS's AI-related revenue run rate is over $15 billion. This illustrates the unprecedented velocity and scale of AI adoption compared to the cloud computing revolution.

While custom silicon is important, Amazon's core competitive edge is its flawless execution in building and powering data centers at massive scale. Competitors face delays, making Amazon's reliability and available power a critical asset for power-constrained AI companies.

AI Infrastructure (AI Infra) solves problems unique to AI/ML, such as managing compute-heavy, GPU-dependent workloads. This marks a shift from traditional infrastructure, which was often more focused on data input/output rather than intensive computation.

The intense computational demand and latency of AI models are compelling enterprises to use multiple cloud providers. Rather than vendor loyalty, companies now prioritize performance, switching between clouds like AWS and Azure to find the fastest available capacity for their AI workloads, reshaping the cloud market.

AWS is investing $1 billion in a new unit of "forward-deployed engineers" (FTEs) to help customers implement AI. This move follows similar initiatives by OpenAI, Anthropic, and Google, indicating that hands-on deployment support is no longer a differentiator for AI labs but a standard, competitive requirement for all major cloud providers.

Amazon's massive investments in Anthropic and OpenAI are not just offensive bets but a necessary strategy to secure their compute volumes. AWS was losing market share to faster-growing Microsoft Azure and Google Cloud, forcing Amazon to "buy" the business of major AI players to stay competitive.