We scan new podcasts and send you the top 5 insights daily.
Pichai says understanding physics and simulating the world at high fidelity are core building blocks for intelligence, so Google pursues world models alongside language models. He points to Argon's state-of-the-art embodied-reasoning results as evidence the work feeds directly into robotics and may eventually converge with LLMs.
The next major leap in AI may come from "world models," which aim to give LLMs an experiential, physical understanding of concepts like space and physics. This mirrors the difference between knowing facts from a book and having real-world experience.
While language models understand the world through text, Demis Hassabis argues they lack an intuitive grasp of physics and spatial dynamics. He sees 'world models'—simulations that understand cause and effect in the physical world—as the critical technology needed to advance AI from digital tasks to effective robotics.
Google's Project Genie, which generates interactive virtual worlds from prompts, is not just a gaming or media tool. It's a foundational part of Google DeepMind's strategy to achieve AGI by creating simulated environments where AI can learn about physics, actions, and consequences.
Vision Language Action models (VLAs) have not yet produced a 'ChatGPT moment' for robotics. Consequently, investor enthusiasm and capital are increasingly flowing towards the alternative 'World Model' approach, which learns physics from video, even though it has yet to demonstrate superior tangible results.
Language is just one 'keyhole' into intelligence. True artificial general intelligence (AGI) requires 'world modeling'—a spatial intelligence that understands geometry, physics, and actions. This capability to represent and interact with the state of the world is the next critical phase of AI development beyond current language models.
Startups and major labs are focusing on "world models," which simulate physical reality, cause, and effect. This is seen as the necessary step beyond text-based LLMs to create agents that can truly understand and interact with the physical world, a key step towards AGI.
Large language models are insufficient for tasks requiring real-world interaction and spatial understanding, like robotics or disaster response. World models provide this missing piece by generating interactive, reason-able 3D environments. They represent a foundational shift from language-based AI to a more holistic, spatially intelligent AI.
Large Language Models are limited because they lack an understanding of the physical world. The next evolution is 'World Models'—AI trained on real-world sensory data to understand physics, space, and context. This is the foundational technology required to unlock physical AI like advanced robotics.
World Labs posits that "world models"—AI focused on visual and physical understanding—represent a new general-purpose platform, similar to LLMs for text. These models can generate, simulate, and reconstruct physical worlds, with applications spanning from robotics and construction to entertainment and VR.
Human intelligence is multifaceted. While LLMs excel at linguistic intelligence, they lack spatial intelligence—the ability to understand, reason, and interact within a 3D world. This capability, crucial for tasks from robotics to scientific discovery, is the focus for the next wave of AI models.