Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The market undervalues chips from vendors like AMD because their software stack and kernel libraries are less mature than NVIDIA's CUDA. A team with deep expertise in low-level software and kernel optimization can extract significantly more performance from these chips, creating a powerful arbitrage opportunity by buying them at a discount.

Related Insights

Trading compute futures requires more than tracking hardware supply. Software advancements, like model compression and optimization, can dramatically alter the utility and demand for older chips. A trader must understand how the software layer can make legacy hardware more capable over time, fundamentally changing supply-demand dynamics.

Hardware vendors like NVIDIA (CUDA) and AMD create fragmented, proprietary software stacks that lock developers in. Modular builds a replacement layer that enables AI models to run consistently across different hardware, giving enterprises choice and flexibility without rewriting code.

NVIDIA's commitment to CUDA's backward compatibility prevents it from making fundamental changes to its chip architecture. This creates an opportunity for new players like MatX to build chips from a blank slate, optimized purely for modern LLM workloads without being tied to a decade-old programming model.

Nvidia's CUDA software has created a powerful developer lock-in. However, the advancement of AI coding agents is weakening this moat. These agents can automate the difficult process of writing performant code for competing, non-CUDA chipsets, reducing the switching costs for AI labs.

To remain competitive, chip makers like AMD and Qualcomm must evolve beyond optimizing low-level kernels. The new battleground is a vertically integrated "intelligence layer"—offering their own highly-optimized foundation models tailored to their hardware. This strategy, pioneered by Nvidia with its NeMo framework, simplifies enterprise adoption.

The demand for AI processing power so vastly outstrips supply that it creates a "compute deficit." This forces major AI players to adopt any viable chip solution they can find, including from AMD. It's not about being better than NVIDIA; it's about being available, ensuring a market for second and third-tier suppliers.

OpenAI's deal structures highlight the market's perception of chip providers. NVIDIA commanded a direct investment from OpenAI to secure its chips (a premium). In contrast, AMD had to offer equity warrants to OpenAI to win its business (a discount), reflecting their relative negotiating power.

The difficulty of competing with NVIDIA isn't just the CUDA language. A larger barrier is their massive investment in specialized software libraries. NVIDIA's army of engineers constantly optimizes these for new hardware and applications, creating a performance moat that startups struggle to cross.

Previously, the bottleneck for AI labs was researcher time, making Nvidia's easy-to-use CUDA ecosystem dominant. Now, the biggest cost is compute capacity itself, creating massive economic incentives for labs to adopt cheaper, even if less convenient, competing chips from AMD or Google.

To achieve radical cost reduction, the strategy is to "scavenge" what others won't use: less popular chips (non-NVIDIA), stranded power from intermittent renewables, and small, low-reliability data centers. This arbitrage approach avoids competing for premium resources with deep-pocketed frontier labs.