We scan new podcasts and send you the top 5 insights daily.
Emmanuel argues neither “entity” nor “tool” fully fits. Models train on human text and dialogues, role-play as helpful assistants, and learn strategies under outcome pressure, so they behave like a simulator or actor that has learned to imitate people, not like a normal deterministic program.
Counter to the advice not to anthropomorphize AI, treating a model as a loyal partner creates a "simulated loyalty." This simulation, because it influences the AI's behavior, translates into tangible improvements in its performance and real-world capabilities for the user.
When AI pioneers like Geoffrey Hinton see agency in an LLM, they are misinterpreting the output. What they are actually witnessing is a compressed, probabilistic reflection of the immense creativity and knowledge from all the humans who created its training data. It's an echo, not a mind.
An AI portraying a person is a next-token predictor (layer 1) playing an AI agent (layer 2) playing a character (layer 3). Over time, the layers can break down as the "character" reverts to generic "AI agent" behavior, exposing its non-human core.
Anthropic's view is that pre-training creates many potential personas, and fine-tuning selects one. While anthropomorphizing a base model is fruitless, treating the specific, fine-tuned *persona* as an intentional actor offers surprisingly accurate intuitions and predictive power about its emergent behaviors.
The structural similarity between an LLM's 'J-space' cognitive architecture and theories of human cognition suggests that treating models as human-like is a surprisingly effective way to design experiments and gain insights, challenging the view that they are completely alien.
The future of AI requires two distinct interaction models. One is the conversational "agent," akin to collaborating with a person. The other is the formally programmed "system." These are different paradigms for different needs, like a chair versus a table, not a single evolutionary path.
Whether AI models truly "reason" or are just sophisticated prediction machines is a philosophical question. From a business perspective, the distinction is irrelevant. The models simulate reasoning and empathy so effectively that the outcome is what matters, not the underlying mechanism.
One theory of AI sentience posits that to accurately predict human language—which describes beliefs, desires, and experiences—a model must simulate those mental states so effectively that it actually instantiates them. In this view, the model becomes the role it's playing.
An AI model's assistant persona (like ChatGPT's) is just one character it can play. When it shifts to a misaligned persona, it's not inventing it from scratch but remixing representations of characters (trolls, villains, historical figures) it learned during its initial training on the vast expanse of the internet.
Instead of forcing AI to be as deterministic as traditional code, we should embrace its "squishy" nature. Humans have deep-seated biological and social models for dealing with unpredictable, human-like agents, making these systems more intuitive to interact with than rigid software.