Pre-training on internet text data is hitting a wall. The next major advancements will come from reinforcement learning (RL), where models learn by interacting with simulated environments (like games or fake e-commerce sites). This post-training phase is in its infancy but will soon consume the majority of compute.

Training AI agents to execute multi-step business workflows demands a new data paradigm. Companies create reinforcement learning (RL) environments—mini world models of business processes—where agents learn by attempting tasks, a more advanced method than simple prompt-completion training (SFT/RLHF).

Many AI projects fail to reach production because of reliability issues. The vision for continual learning is to deploy agents that are 'good enough,' then use RL to correct behavior based on real-world errors, much like training a human. This solves the final-mile reliability problem and could unlock a vast market.

Beyond supervised fine-tuning (SFT) and human feedback (RLHF), reinforcement learning (RL) in simulated environments is the next evolution. These "playgrounds" teach models to handle messy, multi-step, real-world tasks where current models often fail catastrophically.

In this software paradigm, user actions (like button clicks) trigger prompts to a core AI agent rather than executing pre-written code. The application's behavior is emergent and flexible, defined by the agent's capabilities, not rigid, hard-coded rules.

The transition from supervised learning (copying internet text) to reinforcement learning (rewarding a model for achieving a goal) marks a fundamental breakthrough. This method, used in Anthropic's Opus 3 model, allows AI to develop novel problem-solving capabilities beyond simple data emulation.

An "expert agent creator" can learn a new, undocumented technology by reading source code, writing test programs, and learning from failures. It then compiles this experience to create a specialized, highly competent sub-agent, demonstrating autonomous skill acquisition.

As reinforcement learning (RL) techniques mature, the core challenge shifts from the algorithm to the problem definition. The competitive moat for AI companies will be their ability to create high-fidelity environments and benchmarks that accurately represent complex, real-world tasks, effectively teaching the AI what matters.

The trend of buying expensive, simulated Reinforcement Learning (RL) environments is misguided. The most effective and valuable training ground is the live application itself. Companies can achieve better results by using logs and traces from actual users, which provides the most accurate data for agent improvement.