Fine-tuning creates model-specific optimizations that quickly become obsolete. Blitzy favors developing sophisticated, system-level "memory" that captures enterprise-specific context and preferences. This approach is model-agnostic and more durable as base models improve, unlike fine-tuning which requires constant rework.

For specialized, high-stakes tasks like insurance underwriting, enterprises will favor smaller, on-prem models fine-tuned on proprietary data. These models can be faster, more accurate, and more secure than general-purpose frontier models, creating a lasting market for custom AI solutions.

Applications relying solely on generic, off-the-shelf foundation models will eventually hit a performance ceiling. Achieving superior, order-of-magnitude better results for specific workflows requires building a "micro model" through custom data labeling, fine-tuning, and creating a unique reasoning layer to create a defensible product.

The emergence of specialized models like JEV signals a shift away from a "one model fits all" approach. Instead of forcing a single, expensive LLM to perform all tasks, companies will build complex architectures using a "model stack." This involves using fast judgment models for routing and then invoking generative models only when necessary.

For most enterprise tasks, massive frontier models are overkill—a "bazooka to kill a fly." Smaller, domain-specific models are often more accurate for targeted use cases, significantly cheaper to run, and more secure. They focus on being the "best-in-class employee" for a specific task, not a generalist.

Instead of relying solely on massive, expensive, general-purpose LLMs, the trend is toward creating smaller, focused models trained on specific business data. These "niche" models are more cost-effective to run, less likely to hallucinate, and far more effective at performing specific, defined tasks for the enterprise.

The true cost of fine-tuning isn't the initial training but the ongoing maintenance. Base foundation models experience significant capability improvements every 2-3 months. This pace means a custom fine-tuned model can quickly fall behind, forcing a continuous and expensive re-tuning cycle.

By training a smaller, specialized model where company data is in the weights, firms avoid the high token costs of repeatedly feeding context to large frontier models. This makes complex, data-intensive workflows significantly cheaper and faster.

The push towards enterprise fine-tuning directly challenges the 'bitter lesson'—the theory that massive scale in general models will inevitably outperform specialized, human-curated approaches. The success of this new market segment hinges on proving that customized models can maintain a durable advantage over ever-improving, cheaper generalist models.