Instead of trying to anticipate every potential harm, AI regulation should mandate open, internationally consistent audit trails, similar to financial transaction logs. This shifts the focus from pre-approval to post-hoc accountability, allowing regulators and the public to address harms as they emerge.

With federal AI legislation stalled, states like Illinois, California, and New York are passing their own AI safety laws. Leading AI labs are endorsing these bills, recognizing that this state-level patchwork is effectively becoming the national standard for AI governance in the U.S.

With AI incidents rising and safety benchmarks lagging, the era of "trust me" AI governance is ending. The podcast hosts predict that the market will soon demand exportable proof and certifications (like SOC 2 for AI) from vendors before deploying their systems, shifting the impetus for safety from regulators to customers.

OpenAI is shifting its policy strategy, now supporting state-level regulations like those in Illinois. This marks a move away from waiting for a comprehensive federal standard towards a more practical approach that acknowledges public sentiment and the need to build trust locally.

New technologies like electricity, cars, and now AI gain societal trust through a reinforcing cycle. Industry standards create a safety baseline, third-party audits verify compliance, and insurance covers the remaining residual risk, creating a powerful adoption flywheel.

Instead of relying solely on human oversight, AI governance will evolve into a system where higher-level "governor" agents audit and regulate other AIs. These specialized agents will manage the core programming, permissions, and ethical guidelines of their subordinates.

An FDA-style regulatory model would force AI companies to make a quantitative safety case for their models before deployment. This shifts the burden of proof from regulators to creators, creating powerful financial incentives for labs to invest heavily in safety research, much like pharmaceutical companies invest in clinical trials.

For AI safety, Demis Hassabis advocates for an international regulatory body, similar to the International Atomic Energy Agency. This body would have technical experts who audit frontier models against agreed-upon benchmarks, checking for undesirable properties like deception and ensuring public confidence through independent verification.

The approach to AI safety isn't new; it mirrors historical solutions for managing technological risk. Just as Benjamin Franklin's 18th-century fire insurance company created building codes and inspections to reduce fires, a modern AI insurance market can drive the creation and adoption of safety standards and audits for AI agents.