Get your free personalized podcast brief
We scan new podcasts and send you the top 5 insights daily.
In the crowded GPU reseller market, startups like Modal justify high valuations by offering more than just compute. A key driver of Modal's growth is its 'Sandboxes' product, a specialized software layer for safely running AI agents, demonstrating that value is moving from raw infrastructure to agent-specific tooling.
Related Insights
A new category of "NeoCloud" or "AI-native cloud" is rising, focusing specifically on AI training and inference. Unlike general-purpose clouds like AWS, these platforms are GPU-first, catering to massive AI workloads and addressing the GPU scarcity and different workload patterns found in hyperscalers.
Legacy platforms adding AI features are bottlenecked by their old architecture. Truly AI-native companies build agentic reasoning into the foundational control layer, enabling superior performance and interconnectivity between AI components, which creates a durable moat.
Nebius's talks to acquire AI21 reflect a broader trend where NeoClouds (e.g., CoreWeave) are buying software companies. This strategy aims to create a full-stack platform, offering more than just compute power, thereby increasing customer stickiness and diversifying revenue streams beyond commoditized hardware rentals.
Instead of competing with labs on model training, the defensible strategy is to build the ideal environment or 'habitat' for an LLM in a specific vertical. Replit did this for programming by adapting its editor, cloud infrastructure, and deployment tools to serve the AI, not just the human.
The real intellectual property and performance driver for advanced AI systems like Claude Code isn't the underlying model, but the surrounding orchestration layer. This "agent harness" manages memory, tools, and context, and has become the key competitive differentiator.
Providing GPUs-as-a-Service is not a durable business because customers can easily switch providers. The key to customer retention and high net dollar retention (NDR) is the software layer built on top of the hardware. This software, which handles the complexities of inference, creates the actual stickiness.
Most successful SaaS companies weren't built on new core tech, but by packaging existing tech (like databases or CRMs) into solutions for specific industries. AI is no different. The opportunity lies in unbundling a general tool like ChatGPT and rebundling its capabilities into vertical-specific products.
A new category of cloud providers, "NeoClouds," are built specifically for high-performance GPU workloads. Unlike traditional clouds like AWS, which were retrofitted from a CPU-centric architecture, NeoClouds offer superior performance for AI tasks by design and through direct collaboration with hardware vendors like NVIDIA.
Newer AI cloud providers gain a performance advantage by building their infrastructure entirely on NVIDIA's integrated ecosystem, including specialized networking. Incumbent clouds often must patch their legacy, CPU-centric systems, creating inefficiencies that 'neo-clouds' without technical debt can avoid.
As AI agents evolve from information retrieval to active work (coding, QA testing, running simulations), they require dedicated, sandboxed computational environments. This creates a new infrastructure layer where every agent is provisioned its own 'computer,' moving far beyond simple API calls and creating a massive market opportunity.
