Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

After a decade of working on adversarial robustness and being bearish on defenses, Adam Gleave now argues that for LLM misuse cases, the tide has turned. Layered defenses—from account-level bans to model alignment and internal thought monitoring—make it increasingly hard for attackers to succeed persistently.

Related Insights

Instead of maintaining an exhaustive blocklist of harmful inputs, monitoring a model's internal state identifies when specific neural pathways associated with "toxicity" are activated. This proactively detects harmful generation intent, even from novel or benign-looking prompts, solving the cat-and-mouse game of prompt filtering.

Because software code is a language, LLMs are becoming superhuman coders. This makes them incredibly effective at finding system vulnerabilities for hacking (offense). However, this exact same capability makes them equally powerful for identifying and fixing those flaws (defense), leading to a rapid escalation in cybersecurity.

Claiming a "99% success rate" for an AI guardrail is misleading. The number of potential attacks (i.e., prompts) is nearly infinite. For GPT-5, it's 'one followed by a million zeros.' Blocking 99% of a tested subset still leaves a virtually infinite number of effective attacks undiscovered.

Even when a model is successfully jailbroken to produce a harmful output, it often transparently reasons about its malicious task in its chain-of-thought. This makes monitoring the model's internal monologue a powerful external safeguard, as it's hard to make the model lie to itself.

The same AI models that can exploit system vulnerabilities are also the most effective tools for identifying and fixing those weaknesses. This duality creates a policy paradox: restricting the technology to prevent its misuse as a weapon also prevents its use as a defensive shield, leaving systems vulnerable.

Instead of relying on flawed AI guardrails, focus on traditional security practices. This includes strict permissioning (ensuring an AI agent can't do more than necessary) and containerizing processes (like running AI-generated code in a sandbox) to limit potential damage from a compromised AI.

Securing AI agents requires a three-pronged strategy: protecting the agent from external attacks, protecting the world by implementing guardrails to prevent agents from going rogue, and defending against adversaries who use their own agents for attacks. This necessitates machine-scale cyber defense, not just human-scale.

Current AI safety solutions primarily act as external filters, analyzing prompts and responses. This "black box" approach is ineffective against jailbreaks and adversarial attacks that manipulate the model's internal workings to generate malicious output from seemingly benign inputs, much like a building's gate security can't stop a resident from causing harm inside.

Authorization is evolving beyond access control. The next frontier is detecting "intent mismatch," where an agent misinterprets a vague prompt (e.g., "clean this up") and executes a harmful action (e.g., "delete"). Control planes must verify that an agent's planned action aligns with the user's true intent.

The increasing use of AI by malicious actors is creating an exponentially expanding threat landscape. Human-only security teams cannot keep pace, creating a forcing function for organizations to adopt autonomous AI agents for defensive purposes just to survive.