Karpathy argues against the hype of an imminent "year of agents." He believes that while impressive, current AI agents have significant cognitive deficits. Achieving the reliability of a human intern will require a decade of sustained research to solve fundamental problems like continual learning and multimodality.
Related Insights
The popular conception of AGI as a pre-trained system that knows everything is flawed. A more realistic and powerful goal is an AI with a human-like ability for continual learning. This system wouldn't be deployed as a finished product, but as a 'super-intelligent 15-year-old' that learns and adapts to specific roles.
The popular concept of AGI as a static, all-knowing entity is flawed. A more realistic and powerful model is one analogous to a 'super intelligent 15-year-old'—a system with a foundational capacity for rapid, continual learning. Deployment would involve this AI learning on the job, not arriving with complete knowledge.
The advancement of AI is not linear. While the industry anticipated a "year of agents" for practical assistance, the most significant recent progress has been in specialized, academic fields like competitive mathematics. This highlights the unpredictable nature of AI development.
Despite marketing hype, current AI agents are not fully autonomous and cannot replace an entire human job. They excel at executing a sequence of defined tasks to achieve a specific goal, like research, but lack the complex reasoning for broader job functions. True job replacement is likely still years away.
There's a stark contrast in AGI timeline predictions. Newcomers and enthusiasts often predict AGI within months or a few years. However, the field's most influential figures, like Ilya Sutskever and Andrej Karpathy, are now signaling that true AGI is likely decades away, suggesting the current paradigm has limitations.
While language models are becoming incrementally better at conversation, the next significant leap in AI is defined by multimodal understanding and the ability to perform tasks, such as navigating websites. This shift from conversational prowess to agentic action marks the new frontier for a true "step change" in AI capabilities.
The current focus on pre-training AI with specific tool fluencies overlooks the crucial need for on-the-job, context-specific learning. Humans excel because they don't need pre-rehearsal for every task. This gap indicates AGI is further away than some believe, as true intelligence requires self-directed, continuous learning in novel environments.
Karpathy identifies the AI community's 2010s focus on reinforcement learning in games (like Atari) as a misstep. These environments were too sparse and disconnected from real-world knowledge work. Progress required first building powerful representations through large language models, a step that was skipped in early attempts to create agents.
While AI models excel at gathering and synthesizing information ('knowing'), they are not yet reliable at executing actions in the real world ('doing'). True agentic systems require bridging this gap by adding crucial layers of validation and human intervention to ensure tasks are performed correctly and safely.
The tech community's negative reaction to a 10-year AGI forecast reveals just how accelerated expectations have become. A decade ago, such a prediction would have been seen as wildly optimistic, highlighting a massive psychological shift in the industry's perception of AI progress.
