Cohere's co-founder argues that conversations about hypothetical 'digital gods' killing humanity are a distraction. They prevent more practical and urgent discussions about policy solutions for AI-driven wealth inequality and labor market disruption, which are the technology's most pressing societal challenges today.

The emphasis on long-term, unprovable risks like AI superintelligence is a strategic diversion. It shifts regulatory and safety efforts away from addressing tangible, immediate problems like model inaccuracy and security vulnerabilities, effectively resulting in a lack of meaningful oversight today.

While media focuses on "rogue AI," the more immediate danger is that organizations will be too fearful to deploy agents due to a lack of governance. This distrust prevents them from realizing significant productivity gains, making the opportunity cost the biggest risk of all.

Tech leaders catastrophize about AI causing a job apocalypse to make their technology seem seminal and revolutionary. This narrative is a thinly veiled attempt to justify massive valuations and encourage enterprises to invest heavily in their platforms before tangible ROI is proven.

The rhetoric around AI's existential risks is framed as a competitive tactic. Some labs used these narratives to scare investors, regulators, and potential competitors away, effectively 'pulling up the ladder' to cement their market lead under the guise of safety.

The view that safety measures hinder AI performance is a false dichotomy. A model's economic usefulness and profitability are directly tied to its controllability and predictability, making safety and alignment core product features rather than constraints.

Leaders of AI companies frequently invoke lofty goals like curing disease to build public goodwill and justify enormous valuations. This narrative serves as a convenient distraction from more immediate business challenges, like unproven enterprise models or intense competitive pressure.

The narrative of AI's world-changing power and existential risk may be fueled by CEOs' vested interest in securing enormous investments. By framing the technology as revolutionary and dangerous, it justifies higher valuations and larger funding rounds, as Scott Galloway suggests for companies like Anthropic.

Despite hype, current AI agents perform poorly on complex white-collar tasks outside of software engineering. Handshake's CEO points to a new benchmark where the best agents score only 12% on real-world finance jobs, highlighting a major gap between the online narrative and actual enterprise ROI.