As chip manufacturers like NVIDIA release new hardware, inference providers like Base10 absorb the complexity and engineering effort required to optimize AI models for the new chips. This service is a key value proposition, saving customers from the challenging process of re-optimizing workloads for new hardware.

SambaNova avoids direct, broad competition with Nvidia by differentiating itself in "premium inference." This niche focuses on enterprise use cases where ultra-low latency and high performance are critical, such as rapid agent-to-agent communication, creating a defensible market for its specialized hardware.

Google is offering its TPUs externally for the first time as a strategic move to gain market share while it has a temporary hardware advantage over Nvidia. This classic tactic aims to build a crucial install base that can be upgraded later, even after its competitive performance edge inevitably narrows.

By funding and backstopping CoreWeave, which exclusively uses its GPUs, NVIDIA establishes its hardware as the default for the AI cloud. This gives NVIDIA leverage over major customers like Microsoft and Amazon, who are developing their own chips. It makes switching to proprietary silicon more difficult, creating a competitive moat based on market structure, not just technology.

Tech giants often initiate custom chip projects not with the primary goal of mass deployment, but to create negotiating power against incumbents like NVIDIA. The threat of a viable alternative is enough to secure better pricing and allocation, making the R&D cost a strategic investment.

Providing GPUs-as-a-Service is not a durable business because customers can easily switch providers. The key to customer retention and high net dollar retention (NDR) is the software layer built on top of the hardware. This software, which handles the complexities of inference, creates the actual stickiness.

Specialized AI cloud providers like Nebius don't aim to push alternative chips like AMD or TPUs. Instead, they are "market catchers," responding directly to overwhelming customer demand, which is currently focused entirely on NVIDIA. This demand-driven approach dictates their hardware strategy.

Nvidia will likely only revive its ambitions to compete with AWS if its massive hardware profit margins are threatened by competitors like AMD or hyperscalers building their own chips. Only then would Nvidia move up the stack to capture value through an "inference as a service" business model, moving beyond hardware sales.

Newer AI cloud providers gain a performance advantage by building their infrastructure entirely on NVIDIA's integrated ecosystem, including specialized networking. Incumbent clouds often must patch their legacy, CPU-centric systems, creating inefficiencies that 'neo-clouds' without technical debt can avoid.