An AI model's response is not a prediction of what a single user might say, but a probabilistic continuation based on the entirety of its training data—a vast corpus of human writing. Its power stems from this massive-scale pattern matching on our collective cultural output, making it an echo of humanity's written history.

"Amortized inference" bakes slow, deliberative reasoning into a fast, single-pass model. While the brain uses a mix, digital minds have a strong incentive to amortize more capabilities. This is because once a capability is baked in, the resulting model can be copied infinitely, unlike a biological brain.

The "bitter lesson" in AI research posits that methods leveraging massive computation scale better and ultimately win out over approaches that rely on human-designed domain knowledge or clever shortcuts, favoring scale over ingenuity.

The most efficient form of AI-to-AI communication could bypass natural language entirely. A proposed 'latent space transfer protocol' would allow agents to exchange their entire internal state (like a KV cache), akin to a neural link. This is currently feasible with open-weight models and promises huge efficiency gains.

Human intelligence leaped forward when language enabled horizontal scaling (collaboration). Current AI development is focused on vertical scaling (creating bigger 'individual genius' models). The next frontier is distributed AI that can share intent, knowledge, and innovation, mimicking humanity's cognitive evolution.

DeepMind's Shane Legg argues that human intelligence is not the upper limit because the brain is constrained by biology (20-watt power, slow electrochemical signals). Data centers have orders of magnitude advantages in power, bandwidth, and signal speed, making superhuman AI a physical certainty.

Current AI development focuses on "vertical scaling" (bigger models), akin to early humans getting smarter individually. The real breakthrough, like humanity's invention of language, will come from "horizontal scaling"—enabling AI agents to share knowledge and collaborate.

A human driver's lesson from a mistake is isolated. In contrast, when one self-driving car makes an error and learns, the correction is instantly propagated to all other cars in the network. This collective learning creates an exponential improvement curve that individual humans cannot match.

The true advantage of AI-driven science isn't superior creativity but a structural shift in collaboration. AI agents can share all raw data daily, creating a networked intelligence that learns exponentially faster than siloed human labs sharing polished results every few years.