We scan new podcasts and send you the top 5 insights daily.
While frontier models are like supercars for pushing the limits of intelligence, most enterprise tasks (e.g., invoice processing) don't need that power. More efficient, fine-tuned open-weight models are the practical 'Model Y' for everyday business automation, offering better cost-performance for specific workflows.
The performance race in frontier AI models is irrelevant for most business use cases. The vast majority of enterprise AI traffic—an estimated 90%—will run on cheaper, older, or specialized open-source models that are sufficient for day-to-day operational tasks, rather than costly state-of-the-art ones.
With frontier models costing over 100x more than competent alternatives ($56 vs. 50¢ per million tokens), companies are burning cash. An estimated 98% of tasks sent to top-tier models don't require that power, an inefficiency driven by engineers who are disconnected from cost implications.
The optimal strategy for enterprise AI is not to rely solely on expensive frontier models. Instead, companies use a powerful model like Claude or GPT-4 to plan tasks and then delegate the execution to cheaper, fine-tuned open-source models. This massively reduces cost while maintaining high performance.
The biggest AI labs promote their frontier models, but these are often unnecessary for real-world enterprise agentic workflows. More practical and cost-effective solutions can be achieved using smaller proprietary models (like Anthropic's Sonnet) or even open-source alternatives like Muse.
For most enterprise tasks, massive frontier models are overkill—a "bazooka to kill a fly." Smaller, domain-specific models are often more accurate for targeted use cases, significantly cheaper to run, and more secure. They focus on being the "best-in-class employee" for a specific task, not a generalist.
It's economically rational to use expensive, high-IQ frontier models for functions with unlimited upside, like sales or product development. For functions where the goal is precision rather than unbounded creativity (e.g., accurately closing financial books), cheaper, fine-tuned open-weight models are more efficient.
The most advanced AI models are not universally superior; their capabilities form a "jagged frontier." This means organizations can often use more economical, locally-run open-weight models for tasks where they are "good enough," reserving expensive frontier models for specialized needs.
A one-size-fits-all model strategy is inefficient. Roles with unbounded potential upside, like R&D or sales, will justify using expensive, high-performance frontier models. Functions with bounded upside, such as legal or finance, will opt for more cost-effective, specialized open-weight models.
The smartest 'AI-pilled' companies adopt a two-tiered model strategy. They use expensive, frontier models for internal, high-leverage tasks like creating new knowledge and optimizing processes. However, they use cheaper, open-weight models in the 'bill of materials' for the customer-facing product to manage costs effectively.
For repeatable, deterministic workflows, companies can achieve better performance and cost-efficiency by fine-tuning smaller, specialized models. Overusing expensive frontier models for routine tasks is a strategic error in managing "token capital" and AI spend.