Get your free personalized podcast brief
We scan new podcasts and send you the top 5 insights daily.
A major obstacle to coordinated AI safety efforts is the fear of antitrust litigation. Labs are reluctant to agree on pacing or sharing safety techniques because it could be viewed as illegal collusion. Zvi Mowshowitz suggests a simple government action would be to provide an explicit antitrust waiver for such collaborations.
Related Insights
Large AI firms like Anthropic are advocating for stringent government regulation under the guise of safety. However, these proposed rules also serve to raise the barrier to entry, making it more difficult for cheaper, open-source models and startups to compete, thus protecting the incumbents' market share.
Top AI companies like OpenAI and Anthropic cannot unilaterally slow development, even with safety concerns. They fear that competitors or foreign adversaries would seize an insurmountable advantage, forcing them to seek government-led coordination to pace development safely.
Top AI labs like Anthropic publicly state that slowing down AI development would benefit society. However, they are caught in a strategic trap: a unilateral pause is unviable. Without a global agreement, any lab that pauses simply allows less cautious competitors to seize the lead, potentially making the ecosystem less safe.
A significant barrier to voluntary safety pacts among AI companies is antitrust law. An agreement to slow development could be prosecuted as illegal anti-competitive collusion, as it would limit the technology available to consumers. This makes government-led frameworks essential for any coordinated industry action.
Acknowledging their safety plans might be inadequate, leaders from multiple frontier labs have begun to seriously entertain a coordinated slowdown. This represents a major shift, as they also explore legal "safe harbors" to collaborate on safety without triggering antitrust violations, breaking the frame of the current race.
AI leaders aren't ignoring risks because they're malicious, but because they are trapped in a high-stakes competitive race. This "code red" environment incentivizes patching safety issues case-by-case rather than fundamentally re-architecting AI systems to be safe by construction.
CEOs from leading AI labs like Google DeepMind and Anthropic have publicly stated they would prefer to slow down development to address safety concerns. However, they feel compelled to continue the race because if they pause unilaterally, less cautious competitors, including state actors like China, will not.
The "Pacing the Frontier" letter, where AI employees ask for government-mandated slowdowns, highlights a prisoner's dilemma. No single lab can afford to slow down due to "competitive pressure" unless all are forced to do so simultaneously through regulation. This coordination problem is why they appeal to an external authority.
The most likely reason AI companies will fail to implement their 'use AI for safety' plans is not that the technical problems are unsolvable. Rather, it's that intense competitive pressure will disincentivize them from redirecting significant compute resources away from capability acceleration toward safety, especially without robust, pre-agreed commitments.
Individual teams within major AI labs often act responsibly within their constrained roles. However, the overall competitive dynamic and lack of coordination between companies leads to a globally reckless situation, where risks are accepted that no single, rational entity would endorse.
