A core debate in AI is whether LLMs, which are text prediction engines, can achieve true intelligence. Critics argue they cannot because they lack a model of the real world. This prevents them from making meaningful, context-aware predictions about future events—a limitation that more data alone may not solve.

An AI model's response is not a prediction of what a single user might say, but a probabilistic continuation based on the entirety of its training data—a vast corpus of human writing. Its power stems from this massive-scale pattern matching on our collective cultural output, making it an echo of humanity's written history.

The future of AI is hard to predict because increasing a model's scale often produces 'emergent properties'—new capabilities that were not designed or anticipated. This means even experts are often surprised by what new, larger models can do, making the development path non-linear.

A key risk in deploying AI is its inability to generalize to 'long-tail' or out-of-distribution events. Models trained on vast but finite data often fail when encountering novel situations common in the open-ended real world, such as a self-driving car mistaking a stop sign on a billboard for a real one.

What we call "prediction" is just the recognition of recurring patterns from history. The future is genuinely unpredictable because the universe is inherently creative and open-ended. The future doesn't exist yet to be predicted; it must be constructed.

AI models operate in a 'probability space,' making predictions by interpolating from past data. True human creativity operates in a 'possibility space,' generating novel ideas that have no precedent and cannot be probabilistically calculated. This is why AI can't invent something truly new.

AI generates ideas by referencing existing data, making it effective for research but poor for true innovation. Breakthroughs require synthesizing concepts from disparate fields and having a unique vision for the future—capabilities that AI lacks. It provides probable answers, not visionary ones.

Norman Foster argues AI is inherently backward-looking, as it relies on the accumulation of past data. It can optimize existing models but cannot produce paradigm-shifting ideas that have no precedent. Genuine breakthroughs still require a human creative leap beyond history.

AI models are trained on vast datasets of existing knowledge. Like a librarian who has read every book, their answers represent an average of what they have 'read.' This makes AI an aggregator of existing ideas, not a generator of truly novel, outlier concepts.