Recognizing there is no single "best" LLM, AlphaSense built a system to test and deploy various models for different tasks. This allows them to optimize for performance and even stylistic preferences, using different models for their buy-side finance clients versus their corporate users.

Enterprises are currently overspending on tokens by sending all queries to the most powerful LLMs. A new software category will emerge to intelligently route requests to smaller, cheaper models when possible, creating a critical efficiency and cost-saving layer between companies and foundational model providers.

OpenRouter's core thesis is that companies won't rely on one "Uber Black" AI model. Instead, they will orchestrate a diverse set of specialized models ("neurodiversity") for different sub-tasks. This approach improves performance and dramatically cuts inference costs, which are becoming a major operational expense.

Instead of relying on one powerful model for all tasks, the leading strategy is 'smart routing'—using a panel of models and directing each task to the most appropriate one. This compound architecture demonstrably beats single frontier models on both cost and performance.

Enterprises will shift from relying on a single large language model to using orchestration platforms. These platforms will allow them to 'hot swap' various models—including smaller, specialized ones—for different tasks within a single system, optimizing for performance, cost, and use case without being locked into one provider.

The AI agent startup Hey Clicky employs a sophisticated harness. It uses the fast and cheap GPT real-time model to interpret user intent and then route the request to a more capable but expensive model like Fable 5, optimizing both cost and performance.

Companies are building intelligent systems that analyze a user's prompt and automatically route it to the most cost-effective model that can handle the task. This avoids using expensive frontier models for simple requests, with some companies like Coinbase successfully keeping costs flat despite exponential usage growth.

Rather than competing to build a single foundation model, Perplexity's strategy is to be an 'aggregator orchestrator' that intelligently selects the best specialized model for any given task. This allows them to always offer the best performance without owning the underlying models, similar to how Kayak aggregates flights.

To prevent AI agent usage costs from spiraling, GitHub expects the solution will be intelligent model routing. These systems will automatically select the most efficient and cost-effective AI model for a given task, such as using a cheap model for simple refactoring instead of a powerful, expensive one.