Coined in 1965, the "intelligence explosion" describes a runaway feedback loop. An AI capable of conducting AI research could use its intelligence to improve itself. This newly enhanced intelligence would make it even better at AI research, leading to exponential, uncontrollable growth in capability. This "fast takeoff" could leave humanity far behind in a very short period.

The vague concept of AGI is being replaced by Recursive Self-Improvement (RSI)—AI models creating their own successors. This is seen as a more specific and potentially nearer-term threshold that could trigger an uncontrolled explosion in AI progress, moving humans "out of the loop entirely."

The most transformative aspect of AI may be its ability to automate its own research and development. This creates a recursive improvement cycle—an "intelligence explosion"—where progress accelerates exponentially, compressing decades of innovation into a much shorter period.

Once AIs reach human-level competence in AI research and development (R&D), a feedback loop could kick off where they rapidly improve themselves, compressing what would have taken 4-5 years of human-led progress into one.

Jack Clark of Anthropic estimates a 60% probability of achieving end-to-end automated AI R&D by 2028. This "recursive self-improvement," where AI designs better AI, would mark a critical threshold, leading to an intelligence explosion and a future that is nearly impossible to forecast.

The debaters identify the moment AIs can autonomously design their successors (e.g., GPT-6 building GPT-7) as the critical threshold for an "intelligence explosion." Top AI labs are reportedly targeting this capability for 2027, after which human control and understanding may become impossible.

The recent calls to "pace the frontier" by leaders from Anthropic and OpenAI are directly linked to models beginning to exhibit recursive self-improvement—the ability to design their own, more powerful successors. This capability accelerates progress beyond predictable scaling laws, creating uncontrollable risks.

Unlike any prior tool, AI can be directly applied to improve its own creation. It designs more efficient computer chips, writes better training code, and automates research, creating a recursive self-improvement loop that rapidly outpaces human oversight and control.

Once AI systems become proficient at AI R&D, they can trigger a recursive self-improvement loop. This process could radically accelerate progress, potentially achieving an amount of algorithmic advancement in a single year that previously took over a decade. This "intelligence explosion" could rapidly create wildly superhuman systems from a starting point of mere human-level competence.