The discourse often presents a binary: AI plateaus below human level or undergoes a runaway singularity. A plausible but overlooked alternative is a "superhuman plateau," where AI is vastly superior to humans but still constrained by physical limits, transforming society without becoming omnipotent.

Progress in AI isn't a smooth, continuous line. Just as Moore's Law required discrete inventions, AI scaling relies on paradigm shifts. The current Transformer+RL approach may hit diminishing returns, and an AI trained within this paradigm is unlikely to discover the next fundamental breakthrough required to maintain progress.

The fear of runaway Recursive Self-Improvement (RSI) is tempered by economic reality. Training frontier models is becoming more, not less, expensive and complex. Each new model requires more GPUs, time, and brittle engineering, creating a logistical barrier that naturally slows progress.

Recursive self-improvement won't trigger a rapid intelligence explosion because AIs currently lack the ability for genuine strategic decision-making and open-ended research. These skills, crucial for major breakthroughs, are far more than just coding, which is what current AIs excel at.

Once AIs reach human-level competence in AI research and development (R&D), a feedback loop could kick off where they rapidly improve themselves, compressing what would have taken 4-5 years of human-led progress into one.

The most potent counterargument to explosive AI-driven growth is that intelligence itself may have diminishing returns. Past a certain point, even a vastly smarter AI might only solve problems marginally better, not perform "magic." This means the economic benefits could plateau even as intelligence continues to increase.

The expert inside view is that RSI will likely manifest as another significant acceleration in AI capabilities—a "kink" in the progress curve—rather than a sudden, discontinuous singularity. This informs a more measured, though still urgent, approach to planning.

Once AI systems become proficient at AI R&D, they can trigger a recursive self-improvement loop. This process could radically accelerate progress, potentially achieving an amount of algorithmic advancement in a single year that previously took over a decade. This "intelligence explosion" could rapidly create wildly superhuman systems from a starting point of mere human-level competence.

Unlike pure mathematics which is limited only by thought, recursive self-improvement in AI (RSI) is bottlenecked by the time and resources required to run physical experiments like training new models. This physical constraint means progress is a series of serial steps, not an instantaneous intelligence explosion.