The ultra-fast 'East-West' networks connecting GPUs have strict physical limits. Signals must travel between any two GPUs in a cluster within picoseconds, limiting cable lengths to a few hundred meters. This physical constraint directly dictates the layout and maximum size of a single contiguous data hall.

The race for AI performance has shifted from optimizing compute on a single chip to solving system-level connectivity. According to chip infrastructure startup Eliyan, efficiently linking chiplets, chips, and racks is now the primary bottleneck for building next-generation AI systems and maximizing compute utilization.

As AI hardware hits physical limits, photonics (using light for data transfer) is emerging as the critical solution. It simultaneously addresses three major constraints: power consumption, cooling requirements, and data transfer speeds. This makes it a uniquely powerful technology that will enable the next generation of AI infrastructure.

The core challenge of modern AI data centers is managing extreme power density and heat as compute gets packed tighter. The industry is spending trillions to solve the physics problem of moving data over millimeters within chips and racks, a radical shift from traditional data transmission.

Copper reaches severe physical limits where running signals over five meters is costlier than optical transmission over 100 meters. However, immature manufacturing supply chains and insufficient laser foundry capacity will delay mainstream adoption of co-packaged optics in scale-up GPU fabrics until roughly 2028 or 2029.

Traditional network fabrics route erratic, destination-agnostic packets, but AI training and inference produce massive, predictable data flows. This architectural shift enables optical circuit switching directly into the compute complex, blurring the traditional operational boundary between scale-up and scale-out datacenter topologies.

With Moore's Law over, computing progress now depends on networking vast numbers of chips. Lightmatter's photonic interconnects overcome the distance limits of copper cables, allowing thousands of GPUs kilometers apart to function as a single, cohesive supercomputer. This creates a new scaling vector for AI performance.

The inability to create an integrated optical memory, while a challenge, was a blessing in disguise for photonic computing. It prevented researchers from copying the dominant von Neumann architecture and forced them to design novel computing paradigms from the ground up, based on the unique properties of light.

Unlike CMOS chips that perform simple addition/multiplication, photonic chips execute complex functions like Fourier transforms natively. This dramatically reduces data fetched from memory, targeting the 95% of energy currently consumed by data movement, not computation.