/
© 2026 RiffOn. All rights reserved.

Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

  1. Super Data Science: ML & AI Podcast with Jon Krohn
  2. 1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso
1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn · Jun 23, 2026

Go inside an AI data center. Learn about massive power density, liquid cooling myths, complex networks, and the 'screaming banshees' inside.

AI Data Centers Use an 81% "Derating" Factor on Equipment Power Ratings for Realistic Costing

Data centers don't contract for the maximum power listed on hardware ('plate rating'). Instead, they apply a derating factor to estimate realistic usage. Lightning AI uses a conservative 81% factor, which determines the actual contracted power and cost, preventing overpayment for unused capacity.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago

A Separate "Out-of-Band" Network Is a Critical but Often-Skipped Expense for Remote Data Center Management

A true "out-of-band" management network provides a separate, secure channel to manage infrastructure, crucial for 'lights-out' operations. If the main network fails, this allows remote debugging. Many operators skip this expense, forcing them to physically send technicians with laptops to fix issues, which is inefficient and slow.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago

Data Centers Function as Mini Power Stations, Pushing Power Back to Stabilize Local Grids During Crises

Instead of merely straining the power grid, data centers improve its resilience. Through interconnection agreements, they are required to use their onboard generation (generators or fuel cells) to supply power back to the public grid during emergencies like heat waves or storms, acting as distributed power stations.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago

AI Data Centers Require 3x Higher Power Density and Stronger Floors Than Traditional Centers

AI data centers are fundamentally different due to density. A single modern AI server consumes the power of an entire legacy rack (18kW). Additionally, fully-loaded cabinets can weigh over 4,200 pounds, making older raised-floor designs obsolete and requiring reinforced slab floors.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago

Picosecond Timing Requirements Limit High-Speed GPU Networks to a 500-Meter Cable Length

The ultra-fast 'East-West' networks connecting GPUs have strict physical limits. Signals must travel between any two GPUs in a cluster within picoseconds, limiting cable lengths to a few hundred meters. This physical constraint directly dictates the layout and maximum size of a single contiguous data hall.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago

Modern AI Data Centers Use Closed-Loop Liquid Cooling, Consuming No More Water Than a Single Household

Contrary to public perception, modern liquid cooling does not waste water. It uses a sealed, closed-loop glycol system that rejects heat through giant external radiators, much like a car. A massive data center's water usage for this system is minimal, comparable to that of a single family home.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago

Multi-Tenant "NeoClouds" Face Greater Design Complexity Than Single-Tenant AI Systems like OpenAI's

Providers like Lightning AI (NeoClouds) must build for unpredictable, diverse customer workloads. This is harder than building for a single, known purpose like OpenAI does for its own engineers. NeoClouds require more performance headroom and robust multi-tenancy architecture to handle any task a customer might run.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago

AI Data Centers Are Louder Than Rock Concerts, Banning Active Noise-Canceling Headphones for Safety

AI data halls operate at 105-110 decibels, creating a hazardous noise environment. Staff must wear dual passive hearing protection (inner-ear plugs and outer-ear muffs). Active noise-canceling headphones are forbidden because they generate opposing soundwaves at the same high decibel level, which can still cause hearing damage.

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso thumbnail

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

Super Data Science: ML & AI Podcast with Jon Krohn·5 days ago