A 10x increase in compute may only yield a one-tier improvement in model performance. This appears inefficient but can be the difference between a useless "6-year-old" intelligence and a highly valuable "16-year-old" intelligence, unlocking entirely new economic applications.

The relationship between computing power and AI model capability is not linear. According to established 'scaling laws,' a tenfold increase in the compute used for training large language models (LLMs) results in roughly a doubling of the model's capabilities, highlighting the immense resources required for incremental progress.

Brad Lightcap joined OpenAI because he saw the potential of scaling laws. The realization that bigger models predictably improve transformed the AI challenge from a conceptual puzzle into a matter of scaling compute, which became the company's core early conviction.

The massive investment in AI mirrors the HFT speed race. Both are driven by a fear of falling behind and operate on a logarithmic curve of diminishing returns, where each incremental gain requires exponentially more resources. The strategic question in both fields becomes how far to push.

Contrary to the "bitter lesson" narrative that scale is all that matters, novel ideas remain a critical driver of AI progress. The field is not yet experiencing diminishing returns on new concepts; game-changing ideas are still being invented and are essential for making scaling effective in the first place.

The gap between the top few AI labs and the rest is growing, not shrinking. Demis Hassabis explains this is because these labs leverage their own superior tools for coding and math to accelerate development of the next generation of models, creating a powerful compounding advantage that makes it harder for others to catch up.

Demis Hassabis presents a paradox: while AI is experiencing peak short-term hype, its revolutionary potential over a ten-year horizon is still vastly underestimated. This suggests that even the most bullish observers may not fully grasp the magnitude of the changes AI will bring to the economy and society.

Contrary to the prevailing 'scaling laws' narrative, leaders at Z.AI believe that simply adding more data and compute to current Transformer architectures yields diminishing returns. They operate under the conviction that a fundamental performance 'wall' exists, necessitating research into new architectures for the next leap in capability.

Third-party tracker METR observed that model complexity was doubling every seven months. However, a recent proprietary model shattered this trend, demonstrating nearly double the expected capability for independent operation (15 hours vs. an expected 8). This signals that AI advancement is accelerating unpredictably, outpacing prior scaling laws.