Karpathy identifies a key missing piece for continual learning in AI: an equivalent to sleep. Humans seem to use sleep to distill the day's experiences (their "context window") into the compressed weights of the brain. LLMs lack this distillation phase, forcing them to restart from a fixed state in every new session.

Retrieval-Augmented Generation (RAG) is just one component of agent memory. A robust system must also handle dynamic operations like updating information, consolidating knowledge, resolving conflicts, and strategically forgetting obsolete data.

AI models are stateless and "forget" between tasks. The most effective strategy is to create a comprehensive "context library" about your business. This allows you to onboard the AI in seconds for any new task, giving it the equivalent of years of company-specific training instantly.

A new OpenClaw feature called "dreaming" allows the AI agent to process information and consolidate memories overnight while inactive. This concept, borrowed from human neuroscience, aims to improve the agent's long-term learning and performance without requiring active user input, mimicking how humans process experiences during sleep.

In Agentic AI, memory is not just storage but a mechanism for continuity. An AI agent that remembers a user's preferences, history, and context becomes increasingly personalized over time, making it difficult for users to switch to competing services.

Long-running AI agent conversations degrade in quality as the context window fills. The best engineers combat this with "intentional compaction": they direct the agent to summarize its progress into a clean markdown file, then start a fresh session using that summary as the new, clean input. This is like rebooting the agent's short-term memory.

Instead of just expanding context windows, the next architectural shift is toward models that learn to manage their own context. Inspired by Recursive Language Models (RLMs), these agents will actively retrieve, transform, and store information in a persistent state, enabling more effective long-horizon reasoning.

Claude's "Dreams" feature is not automatic learning but an explicit API call to review past sessions and synthesize memories. This design gives developers direct control over when and what an agent learns, transforming memory management from a black box into a deliberate, auditable action.

AI has no memory between tasks. Effective users create a comprehensive "context library" about their business. Before each task, they "onboard" the AI by feeding it this library, giving it years of business knowledge in seconds to produce superior, context-aware results instead of generic outputs.