Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

New techniques allow companies to run sensitive, open-source AI models on rented cloud infrastructure without risk of IP theft. The model, inputs, and outputs are encrypted before being sent to the GPU provider. The provider only ever processes scrambled data, ensuring the user's proprietary information remains secure.

Related Insights

The primary risk of using foreign AI models lies in data transmission, not the model itself. The safest deployment strategy is to download the open-weight model and run it entirely on your own hardware. This 'air-gapped' approach ensures no sensitive data ever leaves your control or transits foreign servers.

A growing number of companies, especially in regulated industries like finance and healthcare, are opting for open-source AI models they can run on-premise. This trend is driven by concerns over data leakage, IP security, and national data sovereignty, creating a distinct market need for more domestic, controllable AI solutions separate from frontier models.

While Apple's long-term strategy is on-device AI, it must still use cloud providers like Google for the most powerful models. To reconcile this with its privacy-first brand, Apple is leveraging NVIDIA's confidential compute, which encrypts data and models even during active processing, thus maintaining its privacy guarantee off-device.

Technologies like Intel TDX and NVIDIA's Confidential Compute encrypt AI workloads directly on hardware. This guarantees that even the physical server owner cannot access the data, allowing anyone to contribute hardware to a decentralized network without needing to be vetted or trusted.

Instead of customers sending sensitive data to its cloud, Mistral deploys its entire technology stack—training and data processing tools—directly onto the customer's own servers. This ensures proprietary data never leaves the client's environment, solving security and compliance challenges.

Using public AI models leaks sensitive corporate data, as prompts and agent traces are sent to model providers. To protect proprietary information and maintain control, enterprises may revert to costly but secure on-premise infrastructure, reversing a 20-year trend of cloud migration.

Sending proprietary enterprise data to external foundational models is a critical mistake that 'leeches' value and intellectual property. The correct, secure approach is to bring AI models into a company's own air-gapped or on-premise environment to maintain data sovereignty and control.

While public discourse on AI safety focuses on existential risk, for enterprises, safety means protecting proprietary knowledge ("alpha"). True enterprise AI safety is achieved by owning the compute, models, and data stack, preventing model providers from stealing trade secrets and customer data.

To overcome corporate distrust, the future of AI adoption hinges on an intermediary 'obfuscation layer.' This allows companies to use their private data to create unique, proprietary versions of an AI model, turning a commodity technology into a competitive advantage without exposing sensitive IP.

Companies are becoming wary of feeding their unique data and customer queries into third-party LLMs like ChatGPT. The fear is that this trains a potential future competitor. The trend will shift towards running private, open-source models on their own cloud instances to maintain a competitive moat and ensure data privacy.