Get your free personalized podcast brief
We scan new podcasts and send you the top 5 insights daily.
Jerry Murdock predicts agents will use an orchestration layer to triage tasks, selecting the best LLM for each job—like expensive Claude for reasoning and cheap open-source models for simple tasks. This shifts value from the models themselves to the agent's intelligent orchestration capabilities.
Related Insights
Recognizing there is no single "best" LLM, AlphaSense built a system to test and deploy various models for different tasks. This allows them to optimize for performance and even stylistic preferences, using different models for their buy-side finance clients versus their corporate users.
Rather than relying on a single LLM, LexisNexis employs a "planning agent" that decomposes a complex legal query into sub-tasks. It then assigns each task (e.g., deep research, document drafting) to the specific LLM best suited for it, demonstrating a sophisticated, model-agnostic approach for enterprise AI.
Navan's CEO sees the debate over which LLM is best as unimportant because the infrastructure is becoming a commodity. The real value is created in the application layer. Navan's own agentic platform, Cognition, intelligently routes tasks to different models (OpenAI, Anthropic, Google) to get the best result for the job.
Enterprises will shift from relying on a single large language model to using orchestration platforms. These platforms will allow them to 'hot swap' various models—including smaller, specialized ones—for different tasks within a single system, optimizing for performance, cost, and use case without being locked into one provider.
The 'agents vs. applications' debate is a false dichotomy. Future applications will be sophisticated, orchestrated systems that embed agentic capabilities. They will feature multiple LLMs, deterministic logic, and robust permission models, representing an evolution of software, not a replacement of it.
A hybrid approach to AI agent architecture is emerging. Use the most powerful, expensive cloud models like Claude for high-level reasoning and planning (the "CEO"). Then, delegate repetitive, high-volume execution tasks to cheaper, locally-run models (the "line workers").
The rise of agent orchestration using specialized, open-source models will drive demand for custom ASICs. Jerry Murdock argues that putting a model on a dedicated chip will be far cheaper and more tunable for specific workloads than using expensive, general-purpose GPUs like Nvidia's, spurring a hardware shift.
Obsessing over linear model benchmarks is becoming obsolete, akin to comparing dial-up speeds. The real value and locus of competition is moving to the "agentic layer." Future performance will be measured by the ability to orchestrate tools, memory, and sub-agents to create complex outcomes, not just generate high-quality token responses.
Anthropic's upcoming 'Agent Mode' for Claude moves beyond simple text prompts to a structured interface for delegating and monitoring tasks like research, analysis, and coding. This productizes common workflows, representing a major evolution from conversational AI to autonomous, goal-oriented agents, simplifying complex user needs.
As foundational AI models become commoditized 'intelligence utilities,' the economic value moves up the stack. Orchestrators like OpenClaw, which can intelligently route tasks to the most efficient model based on cost or use case, are positioned to capture the margin that the underlying model providers cannot.
