Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

A paper co-authored by DeepMind's Chief AGI Scientist offers a new benchmark for superintelligence (ASI): a system that outperforms large organizations of thousands of experts working over extended periods, reframing the goalpost beyond individual human genius.

Related Insights

Dr. Vijoy Pandey defines ASI with two concrete benchmarks: 1) an AI system performing 100% of a human task autonomously (economic viability), and 2) an AI inventing novel ideas beyond its training data without human help (technical viability).

A consortium including leaders from Google and DeepMind has defined AGI as matching the cognitive versatility of a "well-educated adult" across 10 domains. This new framework moves beyond abstract debate, showing a concrete 30-point leap in AGI score from GPT-4 (27%) to a projected GPT-5 (57%).

Framing AGI as reaching human-level intelligence is a limiting concept. Unconstrained by biology, AI will rapidly surpass the best human experts in every field. The focus should be on harnessing this superhuman capability, not just achieving parity.

Hassabis argues AGI isn't just about solving existing problems. True AGI must demonstrate the capacity for breakthrough creativity, like Einstein developing a new theory of physics or Picasso creating a new art genre. This sets a much higher bar than current systems.

OpenAI's CEO believes the term "AGI" is ill-defined and its milestone may have passed without fanfare. He proposes focusing on "superintelligence" instead, defining it as an AI that can outperform the best human at complex roles like CEO or president, creating a clearer, more impactful threshold.

The ultimate goal for companies like OpenAI and Anthropic is not just creating useful products like chatbots, but developing superintelligence—an AI that surpasses human cognitive ability in every domain, akin to the gap between a human and a mouse.

Sundar Pichai shares his working definition of Artificial General Intelligence (AGI), developed with DeepMind CEO Demis Hassabis. He describes it as a system that can comprehensively perform a wide range of tasks, including cognitive ones, in a way that is comparable to human ability.

Shane Legg proposes "Minimal AGI" is achieved when an AI can perform the cognitive tasks a typical person can. It's not about matching Einstein, but about no longer failing at tasks we'd expect an average human to complete. This sets a more concrete and achievable initial benchmark for the field.

Defining AGI as 'human-equivalent' is too limiting because human intelligence is capped by biology (e.g., an IQ of ~160). The truly transformative moment is when AI systems surpass these biological limits, providing access to problem-solving capabilities that are fundamentally greater than any human's.

A practical definition of AGI is its capacity to function as a 'drop-in remote worker,' fully substituting for a human on long-horizon tasks. Today's AI, despite genius-level abilities in narrow domains, fails this test because it cannot reliably string together multiple tasks over extended periods, highlighting the 'jagged frontier' of its abilities.

Google DeepMind Defines Superintelligence as Outperforming Entire Human Organizations | RiffOn