A growing number of companies, especially in regulated industries like finance and healthcare, are opting for open-source AI models they can run on-premise. This trend is driven by concerns over data leakage, IP security, and national data sovereignty, creating a distinct market need for more domestic, controllable AI solutions separate from frontier models.

Relying on third-party APIs for AI is becoming unsustainable due to high token costs and the inherent security risk of uploading sensitive data. This will force a market shift toward powerful local hardware for running private, cost-effective models.

SambaNova's CEO highlights a major trend: large enterprises are adopting on-premise AI to avoid sending sensitive, proprietary data to third-party frontier models. This is driven by security, privacy concerns, and regulatory uncertainty about where their data will end up.

Using public AI models leaks sensitive corporate data, as prompts and agent traces are sent to model providers. To protect proprietary information and maintain control, enterprises may revert to costly but secure on-premise infrastructure, reversing a 20-year trend of cloud migration.

To protect proprietary data and intellectual property, nations and large corporations are increasingly training their own "national models" from scratch. This move away from reliance on global, US-based models creates a significant market for on-prem and private cloud infrastructure that ensures data privacy and security.

The initial assumption of a centralized AI model (large hub, large spoke) is wrong. The new model will involve large foundational hubs, enterprise-specific training hubs, and distributed "spokes" of on-premise hardware for inference. This shift is driven by the need for data control and cost efficiency.

The next major hardware cycle will be driven by user demand for local AI models that run on personal machines, ensuring privacy and control away from corporate or government surveillance. This shift from a purely cloud-centric paradigm will spark massive demand for more powerful personal computers and laptops.

Enterprises are increasingly concerned about sending sensitive data to the cloud via AI agents. The rise of local models, exemplified by platforms like OpenClaw, allows users to run agents on their own devices, ensuring private data never leaves their control and creating a more secure future.

The high cost and data privacy concerns of cloud-based AI APIs are driving a return to on-premise hardware. A single powerful machine like a Mac Studio can run multiple local AI models, offering a faster ROI and greater data control than relying on third-party services.