We scan new podcasts and send you the top 5 insights daily.
A simple average of GPU prices is useless because 'two H100s' can have different CPUs, RAM, and locations. A valid index requires ingesting thousands of daily prices and normalizing them against a base case, using a model that identifies key price-driving factors. This is crucial for creating a reliable hedging instrument.
Trading compute futures requires more than tracking hardware supply. Software advancements, like model compression and optimization, can dramatically alter the utility and demand for older chips. A trader must understand how the software layer can make legacy hardware more capable over time, fundamentally changing supply-demand dynamics.
Unlike typical computer hardware that depreciates rapidly, H100 GPUs are trading above their launch price in secondary markets. This market anomaly, driven by the extreme and sustained compute shortage for AI, completely inverts traditional financial models for hardware assets.
Goldman Sachs and JPMorgan are exploring the creation of futures contracts based on the hourly rental cost of a GPU. This move would transform scarce computing power into a tradable commodity, similar to oil or corn, allowing companies to hedge against price volatility. It marks a significant step in the financialization of the AI industry's core resource.
Despite the rapid pace of hardware innovation, the value of older NVIDIA GPUs like the H100 is holding strong. Cloud provider CoreWeave reports these chips are retaining 90-95% of their pricing power over a 5-6 year lifespan because compute demand far outstrips supply.
Previous attempts at tech futures like DRAM failed because prices only moved in one predictable direction: down. In contrast, the market for GPU compute will experience cycles of high demand and excess supply. This two-way volatility creates genuine hedging needs, making a futures market viable and necessary.
The head of AI at Hudson River Trading highlights a practical barrier to creating a financial market for compute. For serious training, the minimum "lot size" is thousands of GPUs, not a small, fungible unit. This makes it difficult to standardize a contract and create liquidity, unlike commodities with smaller, interchangeable units.
The massive global investment required for AI will drive demand for GPUs so high that the annual market spend will exceed that of crude oil. This scale necessitates a dedicated futures market to allow participants, especially new cloud providers, to hedge price risk and lower their cost of capital.
A futures market for GPU compute is not viable yet because the product isn't fungible. The performance of an identical H100 chip varies significantly between cloud providers based on their proprietary software stack and operational excellence, measured by metrics like "goodput" and "MFUs."
Despite narratives of prices only going up or down, the normalized daily price movement of A100 and H100 chips is 20-30%. This is considered a healthy volatility range for a commodity, creating a genuine need for hedging instruments. If prices were stable, there would be no risk to manage and thus no functional futures market.
The concept of GPUs as a fungible commodity is complicated by significant performance differences between identical chips. Research on A100s shows up to 38% variance due to chip-level and provider differences. This necessitates verification services to ensure buyers get the performance they pay for, challenging the idea of perfect interchangeability.