Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

There's a stark contrast in the AI safety ecosystem. Technical safety work inside labs is high-status and well-funded. However, independent roles in policy or journalism are often dismissed as low-status, with individuals facing accusations of being either industry "shills" or alarmist "doomers."

Related Insights

The term "Doomer" is used as a slur in VC and startup culture against those advocating for AI regulation. It frames safety concerns as anti-progress and pessimistic, and is increasingly tied by the tech right to "woke identity politics" as a way to dismiss them entirely.

It's easy to rationalize that the most impactful role is at a prestigious, high-paying frontier AI company. Aspiring safety workers should rigorously question their own biases and motives, as this conclusion is very convenient. Seek out friends who will challenge your reasoning to avoid self-deception.

Critical media narratives targeting experienced tech leaders in government aim to intimidate future experts from public service. By framing deep industry experience as an inherent conflict of interest, these stories create a vacuum filled by less-qualified academics and career politicians, ultimately harming the quality of policymaking.

Top AI policy experts are leaving government and academia for high-paying roles at frontier AI companies. This mirrors the earlier 'brain drain' of ML researchers and risks a future where AI regulation is overwhelmingly shaped by corporate-employed experts with vested interests.

A strange dynamic exists in AI, where both the labs building the technology and the safety advocates warning against it amplify the narrative of its world-changing potential. This alignment, regardless of sincerity, contributes to the industry's hype and perceived importance.

The narrative that AI risk-awareness is just "doomerism" is a recent phenomenon, strategically pushed by those who stand to benefit commercially from unchecked AI development. In reality, concerns about superintelligence risks have been foundational to the AI industry for decades.

Departures of senior safety staff from top AI labs highlight a growing internal tension. Employees cite concerns that the pressure to commercialize products and launch features like ads is eroding the original focus on safety and responsible development.

While thousands work on AI safety, the field is severely neglected relative to the problem's potential scale. For perspective, the Nature Conservancy alone employs more people (3,000-4,000) than the estimated number working globally on the most severe risks from AGI, highlighting a massive resource disparity.

While interest in AI safety has grown, it's dwarfed by the explosion in AI capabilities research. There are only about 1,000 people in technical AI safety versus up to a million working to accelerate AI capabilities, creating a massive talent imbalance on a critical issue.

Working on AI safety at major labs like Anthropic or OpenAI does not come with a salary penalty. These roles are compensated at the same top-tier rates as capabilities-focused positions, with mid-level and senior researchers likely earning over $1 million, effectively eliminating any financial "alignment tax."