Leaders at frontier labs like OpenAI and Anthropic indicate that RSI—AI models that self-improve—is closer than anticipated. The arrival of RSI would trigger unprecedented demand for compute, as models consume vast resources to develop and improve themselves autonomously.

The immense resources needed for powerful AI, dictated by scaling laws, limits frontier development to a few well-funded, responsible actors. This centralization, while concerning, provides a temporary buffer against widespread misuse and allows for focused alignment efforts, as these few players are more easily monitored and engaged.

Databricks CEO Ali Ghodsi proposes a 4-part litmus test for dangerous recursive self-improvement (RSI). The risk is real only if new models simultaneously require less training time, fewer resources, and achieve higher intelligence, with this cycle being repeatable. Currently, the opposite is true.

Over two-thirds of reasoning models' performance gains came from massively increasing their 'thinking time' (inference scaling). This was a one-time jump from a zero baseline. Further gains are prohibitively expensive due to compute limitations, meaning this is not a repeatable source of progress.

A "software-only singularity," where AI recursively improves itself, is unlikely. Progress is fundamentally tied to large-scale, costly physical experiments (i.e., compute). The massive spending on experimental compute over pure researcher salaries indicates that physical experimentation, not just algorithms, remains the primary driver of breakthroughs.

Contrary to 'hard takeoff' theories, Socher believes AGI's impact will be slowed by physical constraints like hardware availability and economic realities. Many industries, such as luxury goods, tourism, and resource extraction, will not see exponential improvement from superintelligence, thus creating a natural brake on economic disruption.

The recent calls to "pace the frontier" by leaders from Anthropic and OpenAI are directly linked to models beginning to exhibit recursive self-improvement—the ability to design their own, more powerful successors. This capability accelerates progress beyond predictable scaling laws, creating uncontrollable risks.

The expert inside view is that RSI will likely manifest as another significant acceleration in AI capabilities—a "kink" in the progress curve—rather than a sudden, discontinuous singularity. This informs a more measured, though still urgent, approach to planning.

Even if AI fully automates coding tasks at a lab like Anthropic, it may not dramatically accelerate overall research. The real constraint will become access to compute for training and experiments. With human labor effectively infinite, the scarcity of chips becomes the primary bottleneck, limiting the speed of recursive self-improvement.