Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Leaders from Anthropic and DeepMind have voiced support for creating a self-regulatory organization (SRO) for AI, modeled after the financial industry's FINRA. Such a body could establish standards and enforce rules more quickly than government, with real power to decertify non-compliant companies.

Related Insights

David Sacks argues that for a self-regulatory organization (SRO) to be effective and avoid capture by incumbents, it must have broad representation. This means including voices from startups and the open-source community, not just the three largest and most powerful AI labs.

The traditional government model of setting a regulation and waiting years to assess it is obsolete for AI. A new approach is needed: a dynamic board of government, industry, and academic leaders collaborating to make and update rules in real-time.

Dean Ball proposes that regulating AI should model financial services, not pharmaceuticals. Instead of approving each individual model (like a drug), regulators should focus on the institutional soundness and governance of the labs themselves (like banks), as generalist AIs lack clear 'endpoints' for product-specific testing.

By voluntarily restricting access to its new Mythos AI model, Anthropic has provided a clear, real-world model for regulators to copy. This corporate self-regulation makes it far easier for government agencies to enforce similar 'behind closed doors' access policies on other AI labs in the future.

Dario Amodei suggests a novel approach to AI governance: a competitive ecosystem where different AI companies publish the "constitutions" or core principles guiding their models. This allows for public comparison and feedback, creating a market-like pressure for companies to adopt the best elements and improve their alignment strategies.

Contrary to their current stance, major AI labs will pivot to support national-level regulation. The motivation is strategic: a single, predictable federal framework is preferable to navigating an increasingly complex and contradictory patchwork of state-by-state AI laws, which stifles innovation and increases compliance costs.

Major AI companies are not solely seeking to stifle competition with regulation. They are also signaling an inability to self-regulate amidst intense competitive pressure, effectively asking external bodies to impose a mandatory safety floor that applies to everyone.

Proposing a self-regulatory body modeled after FINRA for AI is seen as a deceptive tactic. Critics argue it's not truly "self-regulating" but a fig leaf for a new, slow-moving government agency that will implement pre-release testing and approvals, ultimately creating a "DMV for AI" that stifles innovation.

For AI safety, Demis Hassabis advocates for an international regulatory body, similar to the International Atomic Energy Agency. This body would have technical experts who audit frontier models against agreed-upon benchmarks, checking for undesirable properties like deception and ensuring public confidence through independent verification.

The tech industry is backing a self-regulatory body (SRO) to pre-empt a government agency that could take 5-9 years to approve new AI models. This proactive step aims to prevent a bureaucratic slowdown that would cede the US's innovation speed advantage to competitors like China.