We scan new podcasts and send you the top 5 insights daily.
Assuming software inference expenses will decrease does not guarantee expanding margins because declining compute costs benefit all competitors equally. AI startups demonstrating high gross margins early on offer safer evidence of proprietary defensive value, whereas low-margin companies risk remaining trapped in low-multiple structures.
a16z isn't deterred by AI companies' 0-50% gross margins, a stark contrast to the usual 70% software benchmark. They accept these margins if they stem from LLM costs, focusing instead on whether the company is building defensible value through unique data, workflows, and integrations.
For a true AI-native product, extremely high margins might indicate it isn't using enough AI, as inference has real costs. Founders should price for adoption, believing model costs will fall, and plan to build strong margins later through sophisticated, usage-based pricing tiers rather than optimizing prematurely.
The compute-heavy nature of AI makes traditional 80%+ SaaS gross margins impossible. Companies should embrace lower margins as proof of user adoption and value delivery. This strategy mirrors the successful on-premise to cloud transition, which ultimately drove massive growth for companies like Microsoft.
Unlike in traditional SaaS, low gross margins in an AI company can be a positive indicator. They often reflect high inference costs, which directly correlates with strong user engagement with core AI features. High margins might suggest the AI is not the main product driver.
During major technology shifts like the move to cloud or AI, the best companies (e.g., hyperscalers, Snowflake) often have terrible early margins. In AI, inference costs are falling so rapidly that a company's margin profile can improve dramatically. Judging an early AI company on SaaS-era margin expectations is a mistake.
Counterintuitively, very high gross margins in a company pitching itself as "AI" can be a warning sign. It may indicate that users aren't engaging with the core, computationally expensive AI features. Lower margins can signal genuine, heavy usage of the core AI product.
Unlike SaaS, where high gross margins are key, an AI company with very high margins likely isn't seeing significant use of its core AI features. Low margins signal that customers are actively using compute-intensive products, a positive early indicator.
Contrary to traditional software evaluation, Andreessen Horowitz now questions AI companies that present high, SaaS-like gross margins. This often indicates a critical flaw: customers are not engaging with the costly, core AI features. Low margins, in this context, can be a positive signal of genuine product usage and value delivery.
Many AI startups prioritize growth, leading to unsustainable gross margins (below 15%) due to high compute costs. This is a ticking time bomb. Eventually, these companies must undertake a costly, time-consuming re-architecture to optimize for cost and build a viable business.
Traditional SaaS metrics like 80%+ gross margins are misleading for AI companies. High inference costs lower margins, but if the absolute gross profit per customer is multiples higher than a SaaS equivalent, it's a superior business. The focus should shift from margin percentages to absolute gross profit dollars and multiples.