A 10x increase in compute may only yield a one-tier improvement in model performance. This appears inefficient but can be the difference between a useless "6-year-old" intelligence and a highly valuable "16-year-old" intelligence, unlocking entirely new economic applications.

The progression from early neural networks to today's massive models is fundamentally driven by the exponential increase in available computational power, from the initial move to GPUs to today's million-fold increases in training capacity on a single model.

The relationship between computing power and AI model capability is not linear. According to established 'scaling laws,' a tenfold increase in the compute used for training large language models (LLMs) results in roughly a doubling of the model's capabilities, highlighting the immense resources required for incremental progress.

A key surprise in AI development was the non-linear impact of scale. Sebastian Thrun noted that while AI trained on millions of documents is 'fine,' training it on hundreds of billions creates an 'unbelievably smart' system, shocking even its creators and demonstrating data volume as a primary driver of breakthroughs.

Brad Lightcap joined OpenAI because he saw the potential of scaling laws. The realization that bigger models predictably improve transformed the AI challenge from a conceptual puzzle into a matter of scaling compute, which became the company's core early conviction.

The market often misinterprets AI progress as linear. However, a clear 'scaling law' dictates that a tenfold increase in the computing power used to train LLMs results in a twofold capability improvement. This exponential relationship means future advancements will be far more disruptive and surprising than incremental projections suggest.

AI's computational needs are not just from initial training. They compound exponentially due to post-training (reinforcement learning) and inference (multi-step reasoning), creating a much larger demand profile than previously understood and driving a billion-X increase in compute.

For the first time, investors can trace a direct line from dollars to outcomes. Capital invested in compute predictably enhances model capabilities due to scaling laws. This creates a powerful feedback loop where improved capabilities drive demand, justifying further investment.

Andreessen views AI scaling laws not as physical laws but as powerful, self-fulfilling predictions. Like Moore's Law, they set a benchmark that mobilizes the entire industry—researchers, investors, and engineers—to work towards achieving them, ensuring continued exponential progress.