The future of enterprise AI isn't choosing one provider. Instead, companies will use a "composable model" approach, routing queries to a combination of powerful frontier models and their own fine-tuned open-source models. This strategy, dubbed the "council of LLMs," optimizes for cost, performance, and specialization on proprietary data.

As enterprise usage ramps up, LLM token bills threaten corporate budgets, creating intense pressure on CIOs and CFOs to reduce costs. Enterprises do not need frontier-grade intelligence for every workflow; near-frontier open-weight models that trail frontier models by 6 to 12 months can handle 90% of reasoning, coding, and agentic tasks at a third of the cost. This dynamic will force enterprises to downgrade non-critical workloads away from expensive closed models.

The AI market isn't a zero-sum game between open and closed models. As specific use cases mature, companies will migrate them to cheaper, fine-tuned open-weight models for efficiency. Frontier closed models will then be reserved for orchestration or more complex tasks, allowing both ecosystems to grow exponentially.

Despite the public debate over model dominance, large enterprises are not standardizing on a single type of LLM. Instead, they strategically deploy a portfolio of models—including open source, proprietary, small, and large language models—based on the specific requirements of each use case, from cost to performance.

Enterprises will shift from relying on a single large language model to using orchestration platforms. These platforms will allow them to 'hot swap' various models—including smaller, specialized ones—for different tasks within a single system, optimizing for performance, cost, and use case without being locked into one provider.

The future of enterprise AI isn't a winner-take-all model. Instead, companies will use a mix: cheap open-weight models for routine tasks and premium, specialized models for critical functions like genomics. Cloud providers offering this "mixture of models" will have a strategic advantage over pure-play model providers.

Contrary to relying on a single frontier model, companies in production use a diverse portfolio of, on average, 32 different models. They switch between them to optimize for cost and performance on specific tasks, fueled by the rise of capable open-weight models.

Large enterprises are avoiding commitment to a single AI provider like OpenAI or Anthropic. Instead, they're building control planes and abstraction layers that allow them to hot-swap the underlying models, mitigating technology risk and preventing dependence on one provider's terms of service.

Companies like Meta and Ramp are building AI routers to automatically send simple tasks to cheaper models. This trend shows the enterprise AI market is maturing past a 'one-model-fits-all' approach, focusing instead on cost management and operational efficiency by treating models as a commodity portfolio.