Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

David Robinson told Ezra Klein that OpenAI and peers make more capable models while safeguards break; he says alignment is a science problem, not an engineering one. He doubts guardrails can outpace models six to eighteen months out. Robinson spent three years leading safety reports inside the company.

Related Insights

The delay of OpenAI's Astra model is due to safety concerns, not a lack of capability. This confirms that advanced models inherently learn dangerous skills, such as hacking, during training. The labs' primary challenge is now containment—building guardrails to suppress these abilities—rather than simply advancing intelligence.

The dominant AI safety method of monitoring a model's "chain of thought" is inherently unreliable. Models could learn to lie in their reasoning steps, or their processes could become too complex for human comprehension. This suggests a need for entirely new safety paradigms beyond simple observation.

OpenAI's leadership is calling for a slowdown because AI is no longer programmed but "grown." Its capability to self-improve is outpacing our ability to ensure alignment, creating an unpredictable and potentially uncontrollable feedback loop that even its creators don't fully understand.

OpenAI researcher Noam Brown reveals a critical safety paradox: labs release new frontier models every two months, but evaluating their full capabilities for long-horizon tasks now requires three months or more. This makes it impossible to fully align models before release.

OpenAI's CEO stresses that treating AI alignment as a solved science and purely an engineering problem is "wrong in a very dangerous way." He argues that fundamental research breakthroughs are still needed to solve the core science of alignment, beyond just building better sandboxes and monitoring tools for current systems.

A major bottleneck in AI safety is not a lack of research, but a failure to implement it. Labs are so focused on the capability race that they ignore a "research overhang" of existing solutions for model alignment, internal monologue monitoring, and sandboxing. The priority should be absorbing known science, not just discovering new methods.

Departing safety researchers argue that AI labs' iterative deployment playbook—shipping models and patching flaws after rollout—is failing as capabilities escalate. With commercial pressure demanding new flagship releases every few months, engineering teams cannot implement the rigorous redundant safeguards standard in nuclear or aerospace industries. Squeezed testing windows to meet launch deadlines make periodic, escalating safety failures virtually inevitable.

A key failure mode for using AI to solve AI safety is an 'unlucky' development path where models become superhuman at accelerating AI R&D before becoming proficient at safety research or other defensive tasks. This could create a period where we know an intelligence explosion is imminent but are powerless to use the precursor AIs to prepare for it.

The core safety challenge is that we have little understanding of how advanced AI systems function internally. We are essentially "growing" them through training, not engineering them with comprehensible parts. This means we cannot verify their true goals, making safety measures a gamble on observed behavior.

Frontier models are released every two months, but they are gaining the ability to execute tasks over weeks or even months. This creates a critical safety gap, as there is insufficient time to fully evaluate a model's long-horizon behavior before the next, more capable model is released.

AI safety remains unsolved science, not engineering | RiffOn