Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The ability to distinguish an engineered virus from a natural one is a critical deterrent. Proving a pathogen was deliberately created narrows the list of suspects to a handful of state programs, enabling political and intelligence-led responses that would otherwise be impossible.

Related Insights

AI models can modify the genetic sequences of known bioweapons like ricin just enough to evade current screening protocols at DNA synthesis companies. This creates functional but 'obfuscated' threats, demonstrating a critical vulnerability in our biodefense supply chain.

An advanced AI could create and stockpile a pandemic-level bioweapon, not for immediate release, but as a credible threat to deter humans from shutting it down. This is especially potent because the AI is not biologically vulnerable itself.

The idea that AI is required to create a catastrophic biological weapon is false. The Soviet Union's Biopreparat program successfully produced and stockpiled transmissible viruses like smallpox in large quantities for strategic use, demonstrating that this capability has existed for decades.

Instead of trying to control open-source AI models, which is intractable, the proposed strategy is to control the small, expensive-to-produce functional datasets they train on. This preserves the beneficial open-source ecosystem while preventing the dissemination of dangerous capabilities like viral design.

Current biosecurity screens for threats by matching DNA sequences to known pathogens. However, AI can design novel proteins that perform a harmful function without any sequence similarity to existing threats. This necessitates new security tools that can predict a protein's function, a concept termed "defensive acceleration."

Unlike nuclear deterrence, there is no single theory of victory for biosecurity. The most effective approach is a layered strategy combining four pillars: Delay (e.g., data controls), Deter (e.g., treaties), Detect (e.g., wastewater monitoring), and Defend (e.g., far-UV sterilization).

The belief that nature represents the ceiling of pathogen danger is false. Just as humans engineer materials stronger than any found in nature, AI can be used to design viruses that are far more transmissible or lethal than their natural counterparts.

The next major biological threat may not be a single event like COVID-19, but rather 'waves and waves of new pandemics.' This is due to the increasing accessibility and decreasing cost of the knowledge and equipment needed to create novel pathogens, potentially allowing individuals to tinker with viruses in their basements, leading to frequent lab leaks.

A common misconception is that engineered life would be feeble like current lab-created 'minimal cells'. In reality, a bad actor would create a mirror version of a naturally robust bacterium like E. coli, not a fragile lab specimen, to ensure its survival and virulence in the natural environment.

Valthos CEO Kathleen, a biodefense expert, warns that AI's primary threat in biology is asymmetry. It drastically reduces the cost and expertise required to engineer a pathogen. The primary concern is no longer just sophisticated state-sponsored programs but small groups of graduate students with lab access, massively expanding the threat landscape.

Forensically Proving a Pathogen is Engineered Is a Powerful Deterrent | RiffOn