Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The open vs. closed model debate is misguided. Citing AI company Decagon, the speaker explains that open-source is superior for production workloads needing low latency and fine-tuning (90% of their use). Frontier models are better for initial use-case discovery, explaining their current market share in an early AI market.

Related Insights

Contrary to the popular belief that open-source AI will inevitably catch up, a NIST analysis indicates the performance gap between open and closed-source models is growing. The performance trend lines are diverging, suggesting frontier models are improving at a significantly faster rate.

Decagon's CEO explains a paradox: while open-source AI usage grows, its market share shrinks. This is because open-source is ideal for scaled, defined tasks, but most enterprise AI is still in the experimental phase, where powerful, flexible frontier models are preferred.

Glean's co-founder argues that most enterprise tasks don't require expensive frontier models. Open-source alternatives are now capable enough for the vast majority of use cases. The primary adoption driver has shifted from data privacy to pure cost savings, as enterprises seek to control skyrocketing AI bills.

Contrary to the popular narrative that open-source AI will quickly commoditize the market, there is evidence that the frontier is accelerating faster than the open-source community can keep up. This potential divergence challenges the 'good enough' argument and suggests that proprietary models may maintain a significant, defensible lead for longer than expected.

The choice between expensive frontier models and cheaper open-source ones depends on use case maturity. Enterprises should use powerful, general frontier models to discover new applications. Once a workflow is defined, they can migrate to a smaller, fine-tuned open model for efficiency.

Contrary to relying on a single frontier model, companies in production use a diverse portfolio of, on average, 32 different models. They switch between them to optimize for cost and performance on specific tasks, fueled by the rise of capable open-weight models.

Contrary to past momentum, the most advanced AI startups are increasingly adopting and fine-tuning open-source models. This shift is driven by the need for cost-effective speed and deep customization as their workloads mature and scale.

The most compelling business reason for enterprises to adopt custom fine-tuning is the need for low latency. For real-time applications like voice bots, large frontier models are too slow. This practical constraint forces companies to use smaller, specialized open-source models.

The market isn't a battle between proprietary frontier models and open-source alternatives. Instead, both are seeing parabolic growth. While open-source becomes more capable for simple tasks, the demand for cutting-edge capabilities unlocked by frontier models is also expanding rapidly, creating a positive-sum environment.

The smartest 'AI-pilled' companies adopt a two-tiered model strategy. They use expensive, frontier models for internal, high-leverage tasks like creating new knowledge and optimizing processes. However, they use cheaper, open-weight models in the 'bill of materials' for the customer-facing product to manage costs effectively.