We scan new podcasts and send you the top 5 insights daily.
Leveraging technology developed for satellites, Akash Systems places a thin layer of synthetic diamond—the world's most thermally conductive material—directly onto GPUs. This dramatically lowers temperatures, increases inference speed, and reduces data center energy costs without expensive liquid cooling systems.
The concept of using compute waste heat, pioneered by a Bitcoin-mining-heated bathhouse, is now central to AI. New cooling systems are being designed not just to vent heat, but to process it as an energy asset for heat reuse or electricity generation.
From a first-principles perspective, space is the ideal location for data centers. It offers free, constant solar power (6x more irradiance) and free cooling via radiators facing deep space. This eliminates the two biggest terrestrial constraints and costs, making it a profound long-term shift for AI infrastructure.
The narrative of energy being a hard cap on AI's growth is largely overstated. AI labs treat energy as a solvable cost problem, not an insurmountable barrier. They willingly pay significant premiums for faster, non-traditional power solutions because these extra costs are negligible compared to the massive expense of GPUs.
The two largest physical costs for AI data centers—power and cooling—are essentially free and unlimited in space. A satellite can receive constant, intense solar power without needing batteries and use the near-absolute zero of space for cost-free cooling. This fundamentally changes the economic and physical limits of large-scale computation.
While space offers abundant solar power, the common belief that cooling is "free" is a misconception. Dissipating processor heat is extremely difficult in a vacuum without a medium for convection, making it a significant material science and physics problem, not a simple passive process.
The intense power demands of AI inference will push data centers to adopt the "heterogeneous compute" model from mobile phones. Instead of a single GPU architecture, data centers will use disaggregated, specialized chips for different tasks to maximize power efficiency, creating a post-GPU era.
While many focus on physical infrastructure like liquid cooling, CoreWeave's true differentiator is its proprietary software stack. This software manages the entire data center, from power to GPUs, using predictive analytics to gracefully handle component failures and maximize performance for customers' critical AI jobs.
The CEO of Excelsius argues the traditionally conservative data center sector is ill-prepared for the non-linear innovation demanded by AI. He warns that operators, struggling to keep up, may make "bad decisions" like adopting inadequate single-phase water cooling instead of future-proof two-phase liquid cooling technologies.
Crusoe Cloud's CEO warns of an impending power density crisis. Today's racks are ~130kW, but NVIDIA's future "Vera Rubin Ultra" chips will demand 600kW per rack—the power of a small town. This massive leap will necessitate fundamental changes in cooling and electrical engineering for all AI infrastructure.
The astronomical power and cooling needs of AI are pushing major players like SpaceX, Amazon, and Google toward space-based data centers. These leverage constant, intense solar power and near-absolute zero temperatures for cooling, solving the biggest physical limitations of scaling AI on Earth.