Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Matan from Factory provides hard data on the rapid enterprise shift towards open-source models. Token usage grew from under 1% at the start of the year to over 10% by May. This trend is driven by cost savings and dynamic routing to cheaper, sufficient models for simpler tasks, with a prediction to cross 50% by year-end.

Related Insights

Faced with rising costs from proprietary labs, sophisticated enterprise clients are building internal evaluation and routing systems. This allows them to use cheaper, open-source models for less complex tasks, optimizing for both cost and performance.

After initial unrestricted spending led to budget overruns at companies like Uber, major enterprises are shifting focus. They are moving away from measuring raw AI usage (tokens) and toward implementing AI only for proven use cases with clear ROI, which may benefit cheaper, open-source models over expensive frontier ones.

Glean's co-founder argues that most enterprise tasks don't require expensive frontier models. Open-source alternatives are now capable enough for the vast majority of use cases. The primary adoption driver has shifted from data privacy to pure cost savings, as enterprises seek to control skyrocketing AI bills.

As enterprises become more cost-conscious about token spend, they are actively seeking cheaper alternatives to OpenAI and Anthropic. Data from Ramp shows China's DeepSeek is the top trending software vendor, indicating a new willingness to use foreign or open-source models despite potential data privacy concerns.

The high operational cost of using proprietary LLMs creates 'token junkies' who burn through cash rapidly. This intense cost pressure is a primary driver for power users to adopt cheaper, local, open-source models they can run on their own hardware, creating a distinct market segment.

In response to budget blowouts from agentic AI, enterprises are moving beyond simple adoption to active cost management. A new "token efficiency" stack is emerging, featuring tactics like model routing to cheaper alternatives (e.g., DeepSeek) and custom post-trained models to reduce reliance on expensive foundation models.

Contrary to past momentum, the most advanced AI startups are increasingly adopting and fine-tuning open-source models. This shift is driven by the need for cost-effective speed and deep customization as their workloads mature and scale.

Cost-conscious power users are abandoning expensive frontier models from providers like Anthropic for utilitarian tasks. They are adopting cheaper, high-quality open-source alternatives like GLM 5.2, a trend dubbed 'token budgeting' that signals significant pricing pressure on the incumbent AI labs.

While adoption of open-source AI models has grown fivefold year-over-year, it is still a fringe activity, with only 5% of firms participating. This trend is driven by enterprise demand for cost control, which incumbents like OpenAI and Anthropic have been slow to provide, rather than a wholesale strategic shift.

Misha Laskin, CEO of Reflection AI, states that large enterprises turn to open source models for two key reasons: to dramatically reduce the cost of high-volume tasks, or to fine-tune performance on niche data where closed models are weak.