Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

To manage demand in a supply-constrained market, cloud provider Nebius implemented dynamic pricing via auctions and a 15-minute spot market. CRO Mark Boroditsky reveals this strategy uncovered the true market price for GPUs, showing they had been under-pricing B200 clusters by 15% and their pipeline was 20% below what customers would pay.

Related Insights

AI companies with the foresight to sign long-term, multi-year compute contracts gain a significant margin advantage. They lock in prices based on past valuations, while competitors are forced to buy capacity at much higher current market rates driven up by the increasing value of new AI models.

Amidst a 48% spike in GPU rental costs, AI companies like Anthropic are shifting heavy enterprise users from flat-rate to usage-based pricing. This move, framed as unblocking power users, is fundamentally a response to the industry-wide compute shortage, directly linking the high cost-to-serve with customer pricing.

The advertised per-hour GPU cost is misleading. Because research workloads are spiky and unpredictable, labs over-provision compute. This rampant underutilization means the effective price paid is often 10 times higher than the marketed rate, creating massive deadweight loss.

Companies are using AI agents to continuously scrape competitor pricing data throughout the day. This allows for near real-time, dynamic pricing experiments on their own e-commerce channels, leading to significant revenue increases that were previously impossible at scale.

Specialized AI cloud providers like Nebius don't aim to push alternative chips like AMD or TPUs. Instead, they are "market catchers," responding directly to overwhelming customer demand, which is currently focused entirely on NVIDIA. This demand-driven approach dictates their hardware strategy.

The rise of agentic AI and reinforcement learning is increasing the need for powerful CPUs located near GPUs. Cloud provider Nebius notes CPU requirements can be a high multiple of the GPU count, fueling a new demand cycle.

Despite reports of falling H100 spot rental prices, contract prices for sustained GPU workloads are rising. This indicates the market is shifting from short-term, experimental use to long-term, committed production deployments, reflecting stronger, not weaker, underlying demand for AI infrastructure.

When all cloud providers offer the same NVIDIA hardware, they are forced to compete on price, eroding margins. By integrating specialized hardware like SambaNova's, they can offer premium, differentiated services—such as faster inference on larger models—allowing them to charge more and improve overall business economics.

The market fears rising credit costs will stall the AI buildout. However, existing GPU compute is contracted at prices far below current spot rates. As these contracts expire, repricing will accelerate hyperscaler operating cash flow, allowing them to self-fund expansion without needing as much debt.

The AI compute crunch isn't only about GPU scarcity. Startups are choosing smaller cloud providers ("neoclouds") over AWS because they offer more flexible terms. They can avoid the large, long-term, and expensive commitments that incumbents often require for high-demand NVIDIA chips.

Nebius's Dynamic Auctions Reveal It Underpriced AI Compute by 15-20% | RiffOn