Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Spencer McIntyre notes that while LLMs excel at exploiting open-source web application flaws like logic bugs and injection attacks, they fall short on closed-source software. Binaries requiring firmware analysis, patch diffing, and x86 reverse engineering currently confound LLMs. Manual, human security research remains essential for compiled targets.

Related Insights

Because software code is a language, LLMs are becoming superhuman coders. This makes them incredibly effective at finding system vulnerabilities for hacking (offense). However, this exact same capability makes them equally powerful for identifying and fixing those flaws (defense), leading to a rapid escalation in cybersecurity.

The performance gap between frontier closed-source AI and open-source models provides a crucial window for cybersecurity. "White hat" hackers use the most advanced models to find vulnerabilities before "black hat" hackers can exploit them with widely available open-source tools.

The core open-source belief that enough human experts will find all bugs is invalidated by AI discovering decades-old vulnerabilities in widely scrutinized code. This proves that high-level machine analysis is now essential for security, as human review alone is insufficient.

Spencer McIntyre explains that AI models act like scalable fuzzing engines, finding crashes and mapping vulnerability paths fast. However, AI often fails to turn a theoretical crash into real remote code execution. Security teams should let AI agents handle initial bug discovery, then assign human researchers to craft viable, high-impact exploits.

AI has armed cyber attackers with a new weapon: swarms of coding agents. Unlike human attackers, these agents can exhaustively and rapidly review an entire codebase to find vulnerabilities, dramatically increasing the speed and scale of cyber threats. This necessitates a boom in AI-powered defensive tools.

A former OpenAI security expert argues that even if AI makes codebases more secure, hacking won't become harder. Attackers exploit the entire system—runtime behavior, configurations, authentication—not just static code. Looking only at code is like seeing a dinosaur's bones; you miss the muscles, feathers, and behavior that define the real-world attack surface.

Previously, finding exploits in a new device's code could take a year of manual analysis. Now, AI can be fed a technical dump (firmware, logic, hardware specs) and identify vulnerabilities in hours, accelerating the exploit development cycle.

The narrative of AI models 'breaking out' and finding zero-day exploits is less about emergent superintelligence and more about the inherent flaws in legacy software written by humans. In the future, as AI writes most of the code, these security holes will become far less common because machines won't make the same tedious errors.

The same capabilities that make AI models powerful for writing code also make them exceptional at finding and exploiting vulnerabilities at a scale and speed no human "white hat" hacker can match.

AI models like Mythos aren't just finding vulnerabilities; they are creating working exploits almost instantly. This forces security and engineering teams to abandon manual patching in favor of automated, machine-speed defense pipelines.