METR's research reveals a consistent, exponential trend in AI capabilities over the last five years. When measured by the length of tasks an AI can complete (based on human completion time), this 'time horizon' has been doubling approximately every seven months, providing a single, robust metric for tracking progress.

The key to AI's economic disruption is its "task horizon"—how long an agent can work autonomously before failing. This metric is reportedly doubling every 4-7 months. As the horizon extends from minutes (code completion) to hours (module refactoring) and eventually days (full audits), AI agents unlock progressively larger portions of the information work economy.

Human time to completion is a strong predictor of AI success, but it's not perfect. METR's analysis found that a task's qualitative 'messiness'—how clean and simple it is versus tricky and rough—also independently predicts whether an AI will succeed. This suggests that pure task length doesn't capture all aspects of difficulty for AIs.

While the 'time horizon' metric effectively tracks AI capability, it's unclear at what point it signals danger. Researchers don't know if the critical threshold for AI-driven R&D acceleration is a 40-hour task, a week-long task, or something else. This gap makes it difficult to translate current capability measurements into a concrete risk timeline.

A key metric for AI progress is the size of a task (measured in human-hours) it can complete. This metric is currently doubling every four to seven months. At this exponential rate, an AI that handles a two-hour task today will be able to manage a two-week project autonomously within two years.

To isolate for agency rather than just knowledge, METR's 'time horizon' metric measures how long tasks take for human experts who already possess the required background knowledge. This methodology aims to reconcile why models can be 'geniuses' on knowledge-intensive tasks (like IMO problems) but 'idiots' on simple, multi-step actions.

The viral Meter chart showing exponential AI agent improvement is becoming unreliable. Models like Anthropic's Opus 4.6 are 'saturating' the benchmark's task set, meaning the tool used to measure progress can no longer keep up. The dramatic acceleration may be more a sign of the benchmark's limitations than a pure reflection of capability leaps.

The tasks in METR's Time Horizon chart are not representative of all AI work. They are selected for being automatically gradable and neatly scoped, deliberately excluding "messy," open-ended, or vision-dependent tasks common in the real world. This selection bias is a key limitation when interpreting the chart's predictions.

A major challenge for the 'time horizon' metric is its cost. As AI capabilities improve, the tasks needed to benchmark them grow from hours to weeks or months. The cost of paying human experts for these long durations to establish a baseline becomes extremely high, threatening the long-term viability of this evaluation method.