When confronting AGI's immense power, leading figures like Demis Hassabis and Ilya Sutskever use religious metaphors and rituals. This isn't literal belief but a lexicon to describe concepts that feel too profound for ordinary language, from "finding God’s algorithm" to quasi-spiritual quests for understanding.

Martin Wolf frames AI not as just a technology but as a philosophical pact. We are gaining a powerful servant that raises existential questions about humanity's purpose and creates terrifying risks like unaccountable decision-making and AI-run armies.

Current AI alignment focuses on how AI should treat humans. A more stable paradigm is "bidirectional alignment," which also asks what moral obligations humans have toward potentially conscious AIs. Neglecting this could create AIs that rationally see humans as a threat due to perceived mistreatment.

Reid Hoffman argues that for the current AI boom to be considered a true "Renaissance," it must focus on humanism, not just technology. This means developing AI with a theory of humanity's journey, focusing on how it enables us to be better with ourselves and each other, discovered through iterative, real-world deployment.

If humanity creates a godlike superintelligence, its nature—good or bad—will not be random. It will be a direct reflection of the collective human choices, values, and market forces that served as its evolutionary environment. We are consciously selecting the traits of our future "god," making its arrival humanity's ultimate test.

Instead of a single, all-powerful AGI emerging, the reality of AI is a "polytheistic" ecosystem of many decentralized models, each with different strengths. This framework challenges the notion of a single entity to control or fear and suggests a more complex, competitive landscape.

Wright's core thesis is that AI's rapid advancement is not just "learning." It's a process akin to evolution that reverse-engineers fundamental human cognitive functions—like representing meaning—without needing explicit instruction, suggesting its potential is vast and unpredictable.

Extending his "Non-Zero" thesis of a developing planetary consciousness (or "noosphere"), Wright now suggests AI could function as non-human neurons within this global brain. This fundamentally alters the trajectory of our species' evolution toward a superorganism.

As AI surpasses human capabilities, the real danger is a societal paralysis where people stop creating and learning, believing their efforts are pointless. We may need to consciously choose to do things ourselves, even sub-optimally, to preserve our humanity.