Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Despite the public debate over model dominance, large enterprises are not standardizing on a single type of LLM. Instead, they strategically deploy a portfolio of models—including open source, proprietary, small, and large language models—based on the specific requirements of each use case, from cost to performance.

Related Insights

AI labs profit from token generation, creating a "big token" economy that conflicts with enterprise budgets. The solution is to use a portfolio of models—large ones for complex tasks and smaller, cheaper ones for simple edits—to optimize the cost-performance ratio.

Recognizing there is no single "best" LLM, AlphaSense built a system to test and deploy various models for different tasks. This allows them to optimize for performance and even stylistic preferences, using different models for their buy-side finance clients versus their corporate users.

The future of enterprise AI isn't choosing one provider. Instead, companies will use a "composable model" approach, routing queries to a combination of powerful frontier models and their own fine-tuned open-source models. This strategy, dubbed the "council of LLMs," optimizes for cost, performance, and specialization on proprietary data.

Instead of relying on a single AI provider, Genspark built its application on 70+ models. This 'mixture of agents' architecture orchestrates the best model for any task, providing superior results and preventing vendor lock-in for enterprise clients who fear dependency on one provider.

Rather than committing to a single LLM provider like OpenAI or Gemini, Hux uses multiple commercial models. They've found that different models excel at different tasks within their app. This multi-model strategy allows them to optimize for quality and latency on a per-workflow basis, avoiding a one-size-fits-all compromise.

Enterprises will shift from relying on a single large language model to using orchestration platforms. These platforms will allow them to 'hot swap' various models—including smaller, specialized ones—for different tasks within a single system, optimizing for performance, cost, and use case without being locked into one provider.

Contrary to relying on a single frontier model, companies in production use a diverse portfolio of, on average, 32 different models. They switch between them to optimize for cost and performance on specific tasks, fueled by the rise of capable open-weight models.

Initially, even OpenAI believed a single, ultimate 'model to rule them all' would emerge. This thinking has completely changed to favor a proliferation of specialized models, creating a healthier, less winner-take-all ecosystem where different models serve different needs.

Anticipating the rapid evolution of LLMs, Typeform built its AI infrastructure to be model-agnostic. This strategic decision allows them to switch to the best-performing or most cost-effective model at any time and even use different specialized models for different product features simultaneously.

An emerging rule from enterprise deployments is to use small, fine-tuned models for well-defined, domain-specific tasks where they excel. Large models should be reserved for generic, open-ended applications with unknown query types where their broad knowledge base is necessary. This hybrid approach optimizes performance and cost.