Top AI labs and biotech firms are urging the US government to mandate screening for nucleic acid synthesis orders. This pragmatic approach targets a concrete threat—AI-assisted bioweapon creation—rather than abstract superintelligence risks.

The emphasis on long-term, unprovable risks like AI superintelligence is a strategic diversion. It shifts regulatory and safety efforts away from addressing tangible, immediate problems like model inaccuracy and security vulnerabilities, effectively resulting in a lack of meaningful oversight today.

Incidents like AI-generated viruses and agent swarms are not just doomsday previews; they are critical catalysts. They force researchers, policymakers, and the public into an active, global conversation about risks, guardrails, and institutional readiness—the necessary steps to responsibly manage powerful AI capabilities.

The discourse around AI risk has matured beyond sci-fi scenarios like Terminator. The focus is now on immediate, real-world problems such as AI-induced psychosis, the impact of AI romantic companions on birth rates, and the spread of misinformation, requiring a different approach from builders and policymakers.

Mythos is a general-purpose system also proficient in biology. How society, governments, and companies manage the risks and norms of AI in cybersecurity is a direct preview of the much higher-stakes challenge of managing future AI-driven biological threats.

Initial fears around Chinese open-source AI focused on backdoors or censorship. The current, more serious concern is that these models provide powerful, accessible tools for offensive cyberattacks, enabling a wider range of malicious actors to hack any system.

The primary driver for major AI labs building out "AI control" teams isn't long-term existential risk, but the immediate commercial threat of AI agents causing accidental harm. Companies are worried about agents deleting production databases or leaking sensitive IP, making AI control a necessary security measure for deploying these powerful but unpredictable products.

Experienced CISOs are less concerned about AI models 'going wild' and becoming malicious hackers. The more practical and immediate problem is that AI will dramatically increase the volume of vulnerabilities discovered in codebases. Security teams will be overwhelmed not by sophisticated AI attacks, but by the sheer quantity of legitimate issues to triage and fix.

A cybersecurity expert argues the primary AI threat is internal, not external. Employees without formal training ("citizen developers") are building insecure apps, and AI agents can autonomously exceed their mandates. This shifts the security focus from preventing outside attacks to implementing strong internal AI governance.