Because software code is a language, LLMs are becoming superhuman coders. This makes them incredibly effective at finding system vulnerabilities for hacking (offense). However, this exact same capability makes them equally powerful for identifying and fixing those flaws (defense), leading to a rapid escalation in cybersecurity.

The same AI technology amplifying cyber threats can also generate highly secure, formally verified code. This presents a historic opportunity for a society-wide effort to replace vulnerable legacy software in critical infrastructure, leading to a durable reduction in cyber risk. The main challenge is creating the motivation for this massive undertaking.

Advanced AI cyber tools like Anthropic's Mythos don't create new vulnerabilities; they excel at discovering existing, dormant bugs in human-written code. Their proliferation will catalyze a one-time, industry-wide upgrade cycle, ultimately hardening global infrastructure and leading to a more secure equilibrium between AI-powered offense and defense.

The same AI models that can exploit system vulnerabilities are also the most effective tools for identifying and fixing those weaknesses. This duality creates a policy paradox: restricting the technology to prevent its misuse as a weapon also prevents its use as a defensive shield, leaving systems vulnerable.

The narrative of AI models 'breaking out' and finding zero-day exploits is less about emergent superintelligence and more about the inherent flaws in legacy software written by humans. In the future, as AI writes most of the code, these security holes will become far less common because machines won't make the same tedious errors.

An AI model capable of executing complex cyberattacks is equally capable of identifying and fixing those same vulnerabilities. A government like China's will likely first deploy the model for defense—patching critical systems—before any public or commercial release, thus mitigating risk.

The long-term trajectory for AI in cybersecurity might heavily favor defenders. If AI-powered vulnerability scanners become powerful enough to be integrated into coding environments, they could prevent insecure code from ever being deployed, creating a "defense-dominant" world.

While AI models excel at identifying security vulnerabilities, the next major innovation lies in automatic remediation. The "holy grail" for cybersecurity startups is developing AI systems that can instantly patch and fix identified threats, moving beyond simple detection to proactive, zero-day defense.

While AI will increase cyber risk by enabling faster vulnerability scanning and generating potentially insecure code, it will also be the solution. AI agents will be needed to review code and defend systems, creating a massive new market for "agentic security" companies.