Historically, computer vision treated 3D reconstruction (capturing reality) and generation (creating content) as separate fields. New techniques like NeRFs are merging them, creating a unified approach where models can seamlessly move between perceiving and imagining 3D spaces. This represents a major paradigm shift.

Don't view generative AI video as just a way to make traditional films more efficiently. Ben Horowitz sees it as a fundamentally new creative medium, much like movies were to theater. It enables entirely new forms of storytelling by making visuals that once required massive budgets accessible to anyone.

While LLMs dominate headlines, Dr. Fei-Fei Li argues that "spatial intelligence"—the ability to understand and interact with the 3D world—is the critical, underappreciated next step for AI. This capability is the linchpin for unlocking meaningful advances in robotics, design, and manufacturing.

Large language models are insufficient for tasks requiring real-world interaction and spatial understanding, like robotics or disaster response. World models provide this missing piece by generating interactive, reason-able 3D environments. They represent a foundational shift from language-based AI to a more holistic, spatially intelligent AI.

When LLMs became too computationally expensive for universities, AI research pivoted. Academics flocked to areas like 3D vision, where breakthroughs like NeRF allowed for state-of-the-art results on a single GPU. This resource constraint created a vibrant, accessible, and innovative research ecosystem away from giant models.

World Labs co-founder Fei-Fei Li posits that spatial intelligence—the ability to reason and interact in 3D space—is a distinct and complementary form of intelligence to language. This capability is essential for tasks like robotic manipulation and scientific discovery that cannot be reduced to linguistic descriptions.

Current multimodal models shoehorn visual data into a 1D text-based sequence. True spatial intelligence is different. It requires a native 3D/4D representation to understand a world governed by physics, not just human-generated language. This is a foundational architectural shift, not an extension of LLMs.

Game engines and procedural generation, built for entertainment, now create interactive, simulated models of cities and ecosystems. These "digital twins" allow urban planners and scientists to test scenarios like climate change impacts before implementing real-world solutions.

AR and robotics are bottlenecked by software's inability to truly understand the 3D world. Spatial intelligence is positioned as the fundamental operating system that connects a device's digital "brain" to physical reality. This layer is crucial for enabling meaningful interaction and maturing the hardware platforms.