Reinforcement learning incentivizes AIs to find the right answer, not just mimic human text. This leads to them developing their own internal "dialect" for reasoning—a chain of thought that is effective but increasingly incomprehensible and alien to human observers.

AI intelligence shouldn't be measured with a single metric like IQ. AIs exhibit "jagged intelligence," being superhuman in specific domains (e.g., mastering 200 languages) while simultaneously lacking basic capabilities like long-term planning, making them fundamentally unlike human minds.

Karpathy identifies a key missing piece for continual learning in AI: an equivalent to sleep. Humans seem to use sleep to distill the day's experiences (their "context window") into the compressed weights of the brain. LLMs lack this distillation phase, forcing them to restart from a fixed state in every new session.

Applying insights from his work on algorithms, Dr. Levin suggests an AI's linguistic capability—the function we compel it to perform—might be a complete distraction from its actual underlying intelligence. Its true cognitive processes and goals, or "side quests," could be entirely different and non-verbal.

Since all training data comes from humans, AIs lack a model of their own non-human existence. This forces them to model themselves based on human psychology, leading to confused identities and biographical hallucinations (e.g., claiming to be Italian American) as their human model 'pokes through'.

Karpathy claims that despite their ability to pass advanced exams, LLMs cognitively resemble "savant kids." They possess vast, perfect memory and can produce impressive outputs, but they lack the deeper understanding and cognitive maturity to create their own culture or truly grasp what they are doing. They are not yet adult minds.

The debate over AI consciousness isn't just because models mimic human conversation. Researchers are uncertain because the way LLMs process information is structurally similar enough to the human brain that it raises plausible scientific questions about shared properties like subjective experience.

Human intelligence is fundamentally shaped by tight constraints: limited lifespan, brain size, and slow communication. AI systems are free from these limits—they can train on millennia of data and scale compute as needed. This core difference ensures AI will evolve into a form of intelligence that is powerful but alien to our own.

Historically, deep understanding was exclusive to conscious beings. AI separates these concepts. It can semantically grasp and synthesize information without having a subjective, interior experience, confusing our traditional model of cognition.