While known for its GPUs, NVIDIA's true competitive moat is CUDA, a free software platform that made its hardware accessible for diverse applications like research and AI. This created a powerful network effect and stickiness that competitors struggled to replicate, making NVIDIA more of a software company than observers realize.

While NVIDIA's CUDA software provides a powerful lock-in for AI training, its advantage is much weaker in the rapidly growing inference market. New platforms are demonstrating that developers can and will adopt alternative software stacks for deployment, challenging the notion of an insurmountable software moat.

Large tech companies are actively diversifying their AI chip supply to avoid lock-in with NVIDIA. However, the true challenge isn't just hardware performance. NVIDIA's powerful moat is its extensive software and developer ecosystem, which competitors must also build to truly break free from its market dominance.

For a hyperscaler, the main benefit of designing a custom AI chip isn't necessarily superior performance, but gaining control. It allows them to escape the supply allocations dictated by NVIDIA and chart their own course, even if their chip is slightly less performant or more expensive to deploy.

Overshadowed by NVIDIA, Amazon's proprietary AI chip, Tranium 2, has become a multi-billion dollar business. Its staggering 150% quarter-over-quarter growth signals a major shift as Big Tech develops its own silicon to reduce dependency.

While AWS's Tranium chip lags Nvidia's general-purpose GPUs in raw performance, its success with startup Descartes in real-time video highlights a viable strategy: win by becoming the best-in-class solution for specific, high-value workloads rather than competing head-on.

Anthropic mitigates supply chain risk and optimizes cost by investing heavily in the ability to use NVIDIA, Google, and Amazon chips interchangeably for model development, internal use, and customer service. This orchestration layer is a key competitive advantage.

Amazon's close collaboration with anchor customer Anthropic to optimize Trainium chips resulted in broad software and efficiency improvements. These enhancements benefited the entire ecosystem of Trainium users, demonstrating how a single strategic partnership can accelerate platform-wide maturity.

After being left out of the AI narrative in previous quarters, Amazon's strong earnings were propelled by its cloud and AI business. A key indicator was the 150% quarterly growth of its custom Tranium 2 chip, showing it's effectively competing with other hyperscalers' custom silicon like Google's TPU.