Enterprises are currently overspending on tokens by sending all queries to the most powerful LLMs. A new software category will emerge to intelligently route requests to smaller, cheaper models when possible, creating a critical efficiency and cost-saving layer between companies and foundational model providers.

A key value proposition for vertical AI applications is being model-agnostic. They act as a strategic layer for enterprises, allowing them to route tasks to the best available LLM at any given time. This de-risks enterprise AI strategy from being locked into a single model provider whose performance may be surpassed.

Microsoft is not solely reliant on its OpenAI partnership. It actively integrates competitor models, such as Anthropic's, into its Copilot products to handle specific workloads where they perform better, like complex Excel tasks. This pragmatic "best tool for the job" approach diversifies its AI capabilities.

Navan's CEO sees the debate over which LLM is best as unimportant because the infrastructure is becoming a commodity. The real value is created in the application layer. Navan's own agentic platform, Cognition, intelligently routes tasks to different models (OpenAI, Anthropic, Google) to get the best result for the job.

Microsoft is bundling AI tools into a "super app" and offering a broad model catalog. This positions them as a neutral platform, aiming to win enterprise clients who prioritize control, cost, and choice over loyalty to a specific AI lab like OpenAI or Anthropic.

Microsoft's decision to promote Anthropic models on Azure as aggressively as OpenAI's reflects a core belief from CEO Satya Nadella. He anticipates AI models will become commoditized, making the underlying intelligence interchangeable and the cloud platform the primary point of differentiation and value capture.

Microsoft is making Anthropic's Claude and Co-Work available through its Co-pilot service. This suggests an acknowledgment that their own models aren't always superior and that the future of enterprise AI lies in providing a suite of best-in-class models, not a single-provider ecosystem.

Enterprises will shift from relying on a single large language model to using orchestration platforms. These platforms will allow them to 'hot swap' various models—including smaller, specialized ones—for different tasks within a single system, optimizing for performance, cost, and use case without being locked into one provider.

Jerry Murdock predicts agents will use an orchestration layer to triage tasks, selecting the best LLM for each job—like expensive Claude for reasoning and cheap open-source models for simple tasks. This shifts value from the models themselves to the agent's intelligent orchestration capabilities.