As AI models achieve previously defined benchmarks for intelligence (e.g., reasoning), their failure to generate transformative economic value reveals those benchmarks were insufficient. This justifies 'shifting the goalposts' for AGI. It is a rational response to realizing our understanding of intelligence was too narrow. Progress in impressiveness doesn't equate to progress in usefulness.
AI's value is overestimated because experts view complex jobs as simple, solvable tasks. The real bottleneck is the unproductive effort required to build a custom training pipeline for every company-specific micro-task. Human workers are valuable precisely because they avoid this “schleppy training loop” by learning on the job, a capability current AI lacks.
The current focus on pre-training AI with specific tool fluencies overlooks the crucial need for on-the-job, context-specific learning. Humans excel because they don't need pre-rehearsal for every task. This gap indicates AGI is further away than some believe, as true intelligence requires self-directed, continuous learning in novel environments.
The argument that AI adoption is slow due to normal tech diffusion is flawed. If AI models possessed true human-equivalent capabilities, they would be adopted faster than human employees because they could onboard instantly and eliminate hiring risks. The current lack of widespread economic value is direct evidence that today's AI models are not yet capable enough for broad deployment.