Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

SambaNova's CEO highlights a major trend: large enterprises are adopting on-premise AI to avoid sending sensitive, proprietary data to third-party frontier models. This is driven by security, privacy concerns, and regulatory uncertainty about where their data will end up.

Related Insights

To overcome security and data privacy hurdles in finance and healthcare, Genesis deploys its platform directly within the client's environment, not as a SaaS. This ensures accumulated institutional knowledge becomes a secure, company-owned asset, which is critical for adoption in regulated industries.

Even with contractual promises from tech giants, the history of the internet suggests that "privacy is a game." For corporations with sensitive information, the only certain method to prevent data from being shared or used for training other models is to not share it in the first place, driving demand for on-prem solutions.

Strict regulations prohibit sending sensitive data to external APIs, creating a compliance nightmare for cloud-based AI. Small, on-premise models solve this by keeping data within the enterprise boundary, eliminating third-party processor risks and simplifying audits for regulated industries like healthcare and finance.

The "agentic revolution" will be powered by small, specialized models. Businesses and public sector agencies don't need a cloud-based AI that can do 1,000 tasks; they need an on-premise model fine-tuned for 10-20 specific use cases, driven by cost, privacy, and control requirements.

Instead of customers sending sensitive data to its cloud, Mistral deploys its entire technology stack—training and data processing tools—directly onto the customer's own servers. This ensures proprietary data never leaves the client's environment, solving security and compliance challenges.

Using public AI models leaks sensitive corporate data, as prompts and agent traces are sent to model providers. To protect proprietary information and maintain control, enterprises may revert to costly but secure on-premise infrastructure, reversing a 20-year trend of cloud migration.

Sending proprietary enterprise data to external foundational models is a critical mistake that 'leeches' value and intellectual property. The correct, secure approach is to bring AI models into a company's own air-gapped or on-premise environment to maintain data sovereignty and control.

Enterprises are increasingly concerned about sending sensitive data to the cloud via AI agents. The rise of local models, exemplified by platforms like OpenClaw, allows users to run agents on their own devices, ensuring private data never leaves their control and creating a more secure future.

While public discourse on AI safety focuses on existential risk, for enterprises, safety means protecting proprietary knowledge ("alpha"). True enterprise AI safety is achieved by owning the compute, models, and data stack, preventing model providers from stealing trade secrets and customer data.

Companies in finance and healthcare are hesitant to use public AI providers due to data privacy concerns. On-premise solutions like GoAbacus's "Go One" box allow them to leverage AI locally, ensuring no data leaves their infrastructure and providing cost predictability.