Hugging Face's revenue surged to $150M ARR, a 50% increase in just two months. This growth, driven by reselling compute and storage for open-source models, demonstrates a massive market opportunity for "middle layer" platforms that act as an intermediary between AI developers and complex underlying infrastructure.

Modal Labs provides an infrastructure layer that sits above hyperscalers and specialized AI clouds. Its value is not owning hardware but abstracting the complexity of managing raw GPU capacity. By offering a superior developer experience and a flexible, usage-based model, it solves the variable demand problem inherent in AI applications.

Eric Bernardson says NeoCloud providers are relatively undifferentiated and essentially borrow money upfront to build capacity, then collect payments. He argues Modal's software layer for inference, sandboxes and training is harder to copy and easier to extend downward into infrastructure.

Greg Brockman simplifies OpenAI's business to its most fundamental level: buying or building massive amounts of compute and reselling it with an intelligence layer on top. This framing reveals that their primary growth vector and constraint is access to computation, making their core operation a margin-based resale of processing power.

The compute-heavy nature of AI makes traditional 80%+ SaaS gross margins impossible. Companies should embrace lower margins as proof of user adoption and value delivery. This strategy mirrors the successful on-premise to cloud transition, which ultimately drove massive growth for companies like Microsoft.

Unlike traditional SaaS, AI companies have significant variable costs for compute and tokens. This makes revenue a poor proxy for profitability, as their gross margins are fundamentally different from high-margin software businesses—a fact many investors miss.

Instead of building data centers, Modal runs a software layer across 17 cloud and bare-metal providers. This allows them to focus on software innovation and build a reliability layer that can leverage less-reliable but available 'neo-cloud' capacity.

Modal's first product-market fit was serving companies like Suno (audio) and Runway (video) deploying their own custom models. These non-LLM workloads have highly unpredictable traffic, making Modal's elastic, black-box scaling a key differentiator.

Many AI startups multiply monthly consumption by 12 and label it Annual Recurring Revenue (ARR). True ARR is contracted and committed. This uncommitted "run rate" revenue is not durable and can disappear overnight if a competitor releases a better product, creating a misleading head fake for stakeholders.