We scan new podcasts and send you the top 5 insights daily.
The inability to create an integrated optical memory, while a challenge, was a blessing in disguise for photonic computing. It prevented researchers from copying the dominant von Neumann architecture and forced them to design novel computing paradigms from the ground up, based on the unique properties of light.
To achieve 1000x efficiency, Unconventional AI is abandoning the digital abstraction (bits representing numbers) that has defined computing for 80 years. Instead, they are co-designing hardware and algorithms where the physics of the substrate itself defines the neural network, much like a biological brain.
Cerebras overcame the key obstacle to wafer-scale computing—chip defects—by adopting a strategy from memory design. Instead of aiming for a perfect wafer, they built a massive array of identical compute cores with built-in redundancy, allowing them to simply route around any flaws that occur during manufacturing.
The core architectural bet for Cerebras was that incremental improvements on an existing design (like a GPU) yield minimal gains because the incumbent has already optimized it. To achieve a step-change in performance, a fundamentally different approach is required, leading them to their massive, wafer-scale chip design.
With Moore's Law dead, Shkreli argues the future of computing lies in photonics. Using light for matrix multiplication (MATMOLs) offers a theoretical 1,000x to 1,000,000x performance gain, making it the necessary next frontier despite major technical hurdles.
Hardware shortages act as a catalyst for software innovation. The 'Kimi moment,' where a Chinese model introduced major memory efficiency improvements, demonstrates a recurring pattern: when a component like memory becomes a bottleneck, the ecosystem responds with algorithmic breakthroughs to reduce demand for it.
Martin Shkreli makes a case for photonic computing—using light instead of electrons—as the next major paradigm in AI hardware. He argues that because matrix multiplications (95% of a GPU's job) are a natural function of light interference, photonic chips could offer an "insane speedup" with O-of-one complexity, making them a potential successor to GPUs.
EnCharge AI's innovation was to reframe in-memory analog compute not as a scaled-up memory problem, but as a high-precision analog design problem. They borrowed techniques from medical and aerospace circuits to overcome noise and enable massive efficiency gains.
With Moore's Law over, computing progress now depends on networking vast numbers of chips. Lightmatter's photonic interconnects overcome the distance limits of copper cables, allowing thousands of GPUs kilometers apart to function as a single, cohesive supercomputer. This creates a new scaling vector for AI performance.
The current approach of scaling a single type of qubit technology is inefficient. The founder of quantum startup Sigildry argues the future lies in a multi-modal architecture, architecting systems that combine various quantum hardware types (e.g., trapped ions, photonics) specifically tailored to AI workloads.
Unlike CMOS chips that perform simple addition/multiplication, photonic chips execute complex functions like Fourier transforms natively. This dramatically reduces data fetched from memory, targeting the 95% of energy currently consumed by data movement, not computation.