The AI hardware market is fragmenting. Google is now producing two distinct eighth-generation TPUs: one for training (8t) and one for inference (8i). This move away from one-size-fits-all GPUs shows that optimizing for specific AI workloads is the next competitive frontier.

Google is offering its TPUs externally for the first time as a strategic move to gain market share while it has a temporary hardware advantage over Nvidia. This classic tactic aims to build a crucial install base that can be upgraded later, even after its competitive performance edge inevitably narrows.

Google is abandoning its single-line TPU strategy, now working with both Broadcom and MediaTek on different, specialized TPU designs. This reflects an industry-wide realization that no single chip can be optimal for the diverse and rapidly evolving landscape of AI tasks.

The TPU vs. GPU debate is a proxy for model architecture. OpenAI's sparse models are co-designed for NVIDIA GPUs, while Google and Anthropic's denser models are optimized for TPUs. Choosing a chip is effectively a long-term bet on a specific architectural path for AI models.

Designing custom AI hardware is a long-term bet. Google's TPU team co-designs chips with ML researchers to anticipate future needs. They aim to build hardware for the models that will be prominent 2-6 years from now, sometimes embedding speculative features that could provide massive speedups if research trends evolve as predicted.

Google successfully trained its top model, Gemini 3 Pro, on its own TPUs, proving a viable alternative to NVIDIA's chips. However, because Google doesn't sell these TPUs, NVIDIA retains its monopoly pricing power over every other company in the market.

For its next-generation V7 TPU AI chip, Google is diversifying its supply chain. It's retaining incumbent Broadcom for the complex 'training' version while bringing in low-cost entrant Mediatek for the 'inference' version. This sophisticated strategy mitigates supply risk while keeping critical IP with a trusted partner.

OpenAI is designing its custom chip for flexibility, not just raw performance on current models. The team learned that major 100x efficiency gains come from evolving algorithms (e.g., dense to sparse transformers), so the hardware must be adaptable to these future architectural changes.

Google created its custom TPU chip not as a long-term strategy, but from an internal crisis. Engineer Jeff Dean calculated that scaling a new speech recognition feature to all Android phones would require doubling Google's entire data center footprint, forcing the company to design a more efficient, custom chip to avoid existential costs.