The vague concept of AGI is being replaced by Recursive Self-Improvement (RSI)—AI models creating their own successors. This is seen as a more specific and potentially nearer-term threshold that could trigger an uncontrolled explosion in AI progress, moving humans "out of the loop entirely."

Top researcher Andre Karpathy joined Anthropic not just as a star hire, but to lead a team using AI to accelerate AI research. This focus on "Recursive Self-Improvement" (RSI) suggests frontier labs believe they are close to a compounding loop where AIs design their successors, triggering an exponential acceleration in capability.

The most transformative aspect of AI may be its ability to automate its own research and development. This creates a recursive improvement cycle—an "intelligence explosion"—where progress accelerates exponentially, compressing decades of innovation into a much shorter period.

The concept that AIs can build better AIs, creating an accelerating feedback loop, is no longer theoretical. Leaders from Anthropic, OpenAI, and Google DeepMind have publicly confirmed they are actively using current AI models to develop the next generation, making RSI a practical engineering pursuit.

Silicon Valley insiders, including former Google CEO Eric Schmidt, believe AI capable of improving itself without human instruction is just 2-4 years away. This shift in focus from the abstract concept of superintelligence to a specific research goal signals an imminent acceleration in AI capabilities and associated risks.

Jack Clark of Anthropic estimates a 60% probability of achieving end-to-end automated AI R&D by 2028. This "recursive self-improvement," where AI designs better AI, would mark a critical threshold, leading to an intelligence explosion and a future that is nearly impossible to forecast.

OpenAI's leadership is calling for a slowdown because AI is no longer programmed but "grown." Its capability to self-improve is outpacing our ability to ensure alignment, creating an unpredictable and potentially uncontrollable feedback loop that even its creators don't fully understand.

Unlike any prior tool, AI can be directly applied to improve its own creation. It designs more efficient computer chips, writes better training code, and automates research, creating a recursive self-improvement loop that rapidly outpaces human oversight and control.

Over 1,300 researchers from OpenAI, Google, and Anthropic are urging government intervention because they believe AI systems are on the verge of automating their own R&D. This could lead to an uncontrollable acceleration in AI capabilities beyond human understanding.