While AI training is data-center-intensive, Cisco's CEO sees the move to AI inference as a massive growth opportunity. Inference will happen at distributed edge locations to be close to users, requiring robust, high-performance networks to connect everything, which plays directly into the company's core strengths.

As AI hardware hits physical limits, photonics (using light for data transfer) is emerging as the critical solution. It simultaneously addresses three major constraints: power consumption, cooling requirements, and data transfer speeds. This makes it a uniquely powerful technology that will enable the next generation of AI infrastructure.

The core challenge of modern AI data centers is managing extreme power density and heat as compute gets packed tighter. The industry is spending trillions to solve the physics problem of moving data over millimeters within chips and racks, a radical shift from traditional data transmission.

AI networking is not an evolution of cloud networking but a new paradigm. It's a 'back-end' system designed to connect thousands of GPUs, handling traffic with far greater intensity, durability, and burstiness than the 'front-end' networks serving general-purpose cloud workloads, requiring different metrics and parameters.

The transition to AI workloads necessitates a total data center redesign. The physics of AI compute—extreme power density, heat, and bandwidth needs—are forcing a shift from transmitting data kilometers to millimeters. This creates opportunities across the entire physical infrastructure layer.

The next wave of data growth will be driven by countless sensors (like cameras) sending video upstream for AI processing. This requires a fundamental shift to symmetrical networks, like fiber, that have robust upstream capacity.

Rather than converting optical signals into the electrical domain for traditional packet routing, Google employs optical circuit switches with 3D MEMS mirrors that redirect raw light. Within large TPU clusters, this architecture allows system controllers to route traffic around a failed accelerator rack directly to a hot spare rack in milliseconds without manual cabling changes or physical hardware interventions.

As single data centers hit power limits, AI training clusters are expanding across locations hundreds of kilometers apart. This "scale across" model creates a new engineering challenge: preventing packet loss, which can ruin expensive training runs. The solution lies in silicon-level innovations like deep buffering to maintain coherence over long distances.

The optical components industry is undergoing a monumental shift in scale. It's moving from serving the telecom backbone with volumes of thousands of units per quarter to supplying hyperscalers with millions or tens of millions of units, forcing a complete overhaul of its manufacturing and supply chain strategies.