To meet strict enterprise security and governance requirements, Snowflake's strategy is to "bring AI to the data." Through partnerships with cloud and model providers, inference is run inside the Snowflake security boundary, preventing sensitive data from being moved.

For specialized, high-stakes tasks like insurance underwriting, enterprises will favor smaller, on-prem models fine-tuned on proprietary data. These models can be faster, more accurate, and more secure than general-purpose frontier models, creating a lasting market for custom AI solutions.

Despite public hype around powerful consumer AI, many product managers in large companies are forbidden from using them. Strict IT constraints against uploading internal documents to external tools create a significant barrier, slowing adoption until secure, sandboxed enterprise solutions are implemented.

Instead of relying solely on massive, expensive, general-purpose LLMs, the trend is toward creating smaller, focused models trained on specific business data. These "niche" models are more cost-effective to run, less likely to hallucinate, and far more effective at performing specific, defined tasks for the enterprise.

The "agentic revolution" will be powered by small, specialized models. Businesses and public sector agencies don't need a cloud-based AI that can do 1,000 tasks; they need an on-premise model fine-tuned for 10-20 specific use cases, driven by cost, privacy, and control requirements.

In sectors like finance or healthcare, bypass initial regulatory hurdles by implementing AI on non-sensitive, public information, such as analyzing a company podcast. This builds momentum and demonstrates value while more complex, high-risk applications are vetted by legal and IT teams.

Standalone AI tools often lack enterprise-grade compliance like HIPAA and GDPR. A central orchestration platform provides a crucial layer for access control, observability, and compliance management, protecting the business from risks associated with passing sensitive data to unvetted AI services.

For AI to function as a "second brain"—synthesizing personal notes, thoughts, and conversations—it needs access to highly sensitive data. This is antithetical to public cloud AI. The solution lies in leveraging private, self-hosted LLMs that protect user sovereignty.

Companies are becoming wary of feeding their unique data and customer queries into third-party LLMs like ChatGPT. The fear is that this trains a potential future competitor. The trend will shift towards running private, open-source models on their own cloud instances to maintain a competitive moat and ensure data privacy.