We scan new podcasts and send you the top 5 insights daily.
Unlike AI startups that fine-tune models immediately, enterprise token usage will primarily come from adapting systems and harnesses around base models. Most enterprises encounter significant operational friction fine-tuning internal data and instead achieve task customization by wrapping off-the-shelf open models in bespoke agent workflows.
Fine-tuning creates model-specific optimizations that quickly become obsolete. Blitzy favors developing sophisticated, system-level "memory" that captures enterprise-specific context and preferences. This approach is model-agnostic and more durable as base models improve, unlike fine-tuning which requires constant rework.
The key for enterprises isn't integrating general AI like ChatGPT but creating "proprietary intelligence." This involves fine-tuning smaller, custom models on their unique internal data and workflows, creating a competitive moat that off-the-shelf solutions cannot replicate.
The biggest AI labs promote their frontier models, but these are often unnecessary for real-world enterprise agentic workflows. More practical and cost-effective solutions can be achieved using smaller proprietary models (like Anthropic's Sonnet) or even open-source alternatives like Muse.
Despite the public debate over model dominance, large enterprises are not standardizing on a single type of LLM. Instead, they strategically deploy a portfolio of models—including open source, proprietary, small, and large language models—based on the specific requirements of each use case, from cost to performance.
The "agentic revolution" will be powered by small, specialized models. Businesses and public sector agencies don't need a cloud-based AI that can do 1,000 tasks; they need an on-premise model fine-tuned for 10-20 specific use cases, driven by cost, privacy, and control requirements.
In response to budget blowouts from agentic AI, enterprises are moving beyond simple adoption to active cost management. A new "token efficiency" stack is emerging, featuring tactics like model routing to cheaper alternatives (e.g., DeepSeek) and custom post-trained models to reduce reliance on expensive foundation models.
The most compelling business reason for enterprises to adopt custom fine-tuning is the need for low latency. For real-time applications like voice bots, large frontier models are too slow. This practical constraint forces companies to use smaller, specialized open-source models.
Fine-tuning remains relevant but is not the primary path for most enterprise use cases. It's a specialized tool for situations with unique data unseen by foundation models or when strict cost and throughput requirements for a high-volume task justify the investment. Most should start with RAG.
Companies like Thinking Machines Lab and Microsoft are shifting the value proposition from raw API access to platforms for enterprise-specific model customization. This addresses corporate needs for data sovereignty, cost control, and specialized performance, creating a new competitive lane focused on enabling customers to own their own models.
Fine-tuning, once dismissed as obsolete due to powerful foundation models, is making a comeback. Faced with expensive pay-as-you-go APIs for long-running agents and geopolitical supply risks, companies are returning to fine-tuning smaller, self-hosted models to gain cost control and operational resilience.