Proposed AI safety regulations could create a 'regulatory moat' for giants like Google. The high cost and complexity of navigating an approval process can stifle smaller open-source projects, which lack regulatory budgets. In contrast, large, well-funded companies can absorb these costs, solidifying their market dominance.

Large AI firms like Anthropic are advocating for stringent government regulation under the guise of safety. However, these proposed rules also serve to raise the barrier to entry, making it more difficult for cheaper, open-source models and startups to compete, thus protecting the incumbents' market share.

As enterprises replace expensive proprietary models with cheaper open-source alternatives, frontier labs like OpenAI and Anthropic face an existential threat. Their strategic response could be to lobby for regulations that effectively make open-source models illegal, creating a protective moat.

Anthropic's public stance advocating for a regulatory approval process for AI models, while framed around safety, could create a competitive moat. This strategy leverages political concerns about AI danger and China to potentially establish a de facto ban on open-weight models, benefiting their closed-model business.

The proposed White House framework for reviewing advanced AI models applies to closed-source systems from companies like OpenAI but exempts open-weight models from Meta and others. This creates a potential regulatory loophole, as open-weight models can be harder to control and monitor once released into the wild.

Anthropic publicly stokes fears about AI's dangers to invite government regulation. This is a deliberate strategy to create compliance burdens that open-source competitors cannot meet, effectively legislating them out of existence and capturing the market.

Unlike past tech waves where companies resisted government oversight, today's AI leaders are actively inviting it. This is a strategic move to shape regulations in their favor, creating barriers to entry for smaller players and open-source competitors under the guise of safety and responsibility.

Demis Hassabis's detailed proposal for a US-led AI standards body is comprehensive. Its most challenging and controversial aspect, however, is the requirement to apply safety rules to all frontier models deployed in the US, including those from foreign entities and the open-source community, which faces significant enforcement hurdles.

The push for AI regulation, often led by companies like Anthropic, is likely leading toward an attempt to ban open-source models. The justification will be that open models lack guardrails and are therefore dangerous, effectively cementing the power of a few closed-source providers.