Get your free personalized podcast brief
We scan new podcasts and send you the top 5 insights daily.
Each layer of abstraction in modern computers—from digital 1s and 0s up to neural networks—is inherently "lossy" and creates inefficiency. A more efficient approach bypasses these layers by directly connecting the physics of a semiconductor to the structure of a neural network, mimicking how brains compute without linear algebra.
Related Insights
To achieve 1000x efficiency, Unconventional AI is abandoning the digital abstraction (bits representing numbers) that has defined computing for 80 years. Instead, they are co-designing hardware and algorithms where the physics of the substrate itself defines the neural network, much like a biological brain.
Digital computing, the standard for 80 years, is too power-hungry for scalable AI. Unconventional AI's Naveen Rao is betting on analog computing, which uses physics to perform calculations, as a more energy-efficient substrate for the unique demands of intelligent, stochastic workloads.
Breakthroughs like neural network "pruning" can reduce model size by 90% without losing accuracy, offering a 10x reduction in inference costs. This highlights that algorithmic innovation, not just acquiring more hardware, will be a key competitive vector in the AI race, enabling more output with less energy.
The primary motivation for biocomputing is not just scientific curiosity; it's a direct response to the massive, unsustainable energy consumption of traditional AI. Living neurons are up to 1,000,000 times more energy-efficient, offering a path to dramatically cheaper and greener AI.
We are building AI, a fundamentally stochastic and fuzzy system, on top of highly precise and deterministic digital computers. Unconventional AI founder Naveen Rao argues this is a profound mismatch. The goal is to build a new computing substrate—analog circuits—that is isomorphic to the nature of intelligence itself.
Today's transformers are optimized for matrix multiplication (MatMul) on GPUs. However, as compute scales to distributed clusters, MatMul may not be the most efficient primitive. Future AI architectures could be drastically different, built on new primitives better suited for large-scale, distributed hardware.
New AI models are moving away from brute-force computation. By selectively focusing on relevant data, much like the human brain indexes memories, they can achieve massive performance gains and cost reductions, overcoming a major bottleneck in current architectures.
Counter-intuitively, selectively removing connections in a complex computing system (sparsity) can lead to superior results. This approach not only makes the system more energy-efficient and scalable (avoiding n-squared scaling), but it also improves its overall performance by making it more trainable—a "holy grail" in system design.
A "dynamical computer" performs calculations as an emergent property of its physical system, much like metronomes synchronizing on a plank. This paradigm merges compute and memory into one element, eliminating the massive energy cost of moving data that defines traditional von Neumann architecture.
Biological intelligence has no OS or APIs; the physics of the brain *is* the computation. Unconventional AI's CEO Naveen Rao argues that current AI is inefficient because it runs on layers of abstraction. The future is hardware where intelligence is an emergent property of the system's physics.