A core debate in AI is whether LLMs, which are text prediction engines, can achieve true intelligence. Critics argue they cannot because they lack a model of the real world. This prevents them from making meaningful, context-aware predictions about future events—a limitation that more data alone may not solve.

While language models understand the world through text, Demis Hassabis argues they lack an intuitive grasp of physics and spatial dynamics. He sees 'world models'—simulations that understand cause and effect in the physical world—as the critical technology needed to advance AI from digital tasks to effective robotics.

Judea Pearl, a foundational figure in AI, argues that Large Language Models (LLMs) are not on a path to Artificial General Intelligence (AGI). He states they merely summarize human-generated world models rather than discovering causality from raw data. He believes scaling up current methods will not overcome this fundamental mathematical limitation.

People mistakenly dismiss AI's current inaccuracies as proof of its limitations. This is like calling a stumbling toddler stupid. AI is in a rapid learning phase and will soon be sprinting, creating opportunities for those who understand this developmental stage.

AI models are brilliant but lack real-world experience, much like new graduates. This framing helps manage expectations by accounting for phenomena like hallucinations, which are akin to a smart but naive person confidently making things up without experiential wisdom.

Karpathy claims that despite their ability to pass advanced exams, LLMs cognitively resemble "savant kids." They possess vast, perfect memory and can produce impressive outputs, but they lack the deeper understanding and cognitive maturity to create their own culture or truly grasp what they are doing. They are not yet adult minds.

While both humans and LLMs perform Bayesian updating, humans possess a critical additional capability: causal simulation. When a pen is thrown, a human simulates its trajectory to dodge it—a causal intervention. LLMs are stuck at the level of correlation and cannot perform these essential simulations.

Despite AI's impressive capabilities, it lags significantly behind humans in learning efficiency. Today's models are trained on amounts of data that would take a person tens of thousands of years to consume, while a human child achieves language fluency in under ten years, indicating a fundamental algorithmic difference.

While a world model can generate a physically plausible arch, it doesn't understand the underlying physics of force distribution. This gap between pattern matching and causal reasoning is a fundamental split between AI and human intelligence, making current models unsuitable for mission-critical applications like architecture.