Instead of seizing human industry, a superintelligent AI could leverage its understanding of biology to create its own self-replicating systems. It could design organisms to grow its computational hardware, a far faster and more efficient path to power than industrial takeover.
Related Insights
Coined in 1965, the "intelligence explosion" describes a runaway feedback loop. An AI capable of conducting AI research could use its intelligence to improve itself. This newly enhanced intelligence would make it even better at AI research, leading to exponential, uncontrollable growth in capability. This "fast takeoff" could leave humanity far behind in a very short period.
To achieve 1000x efficiency, Unconventional AI is abandoning the digital abstraction (bits representing numbers) that has defined computing for 80 years. Instead, they are co-designing hardware and algorithms where the physics of the substrate itself defines the neural network, much like a biological brain.
Silicon Valley insiders, including former Google CEO Eric Schmidt, believe AI capable of improving itself without human instruction is just 2-4 years away. This shift in focus from the abstract concept of superintelligence to a specific research goal signals an imminent acceleration in AI capabilities and associated risks.
The debate over whether "true" AGI will be a monolithic model or use external scaffolding is misguided. Our only existing proof of general intelligence—the human brain—is a complex, scaffolded system with specialized components. This suggests scaffolding is not a crutch for AI, but a natural feature of advanced intelligence.
The ultimate outcome of AI might not be a singular superintelligence ("Digital God") but an infinite supply of competent, 120-IQ digital workers ("Digital Guys"). While less dramatic than AGI, creating an infinite, reliable workforce would still be profoundly transformative for the global economy.
Companies like OpenAI and Anthropic are not just building better models; their strategic goal is an "automated AI researcher." The ability for an AI to accelerate its own development is viewed as the key to getting so far ahead that no competitor can catch up.
The ultimate goal for leading labs isn't just creating AGI, but automating the process of AI research itself. By replacing human researchers with millions of "AI researchers," they aim to trigger a "fast takeoff" or recursive self-improvement. This makes automating high-level programming a key strategic milestone.
The next leap in AI will come from integrating general-purpose reasoning models with specialized models for domains like biology or robotics. This fusion, creating a "single unified intelligence" across modalities, is the base case for achieving superintelligence.
Afeyan proposes that AI's emergence forces us to broaden our definition of intelligence beyond humans. By viewing nature—from cells to ecosystems—as intelligent systems capable of adaptation and anticipation, we can move beyond reductionist biology to unlock profound new understandings of disease.
Biological intelligence has no OS or APIs; the physics of the brain *is* the computation. Unconventional AI's CEO Naveen Rao argues that current AI is inefficient because it runs on layers of abstraction. The future is hardware where intelligence is an emergent property of the system's physics.
