Formal regulations are struggling to keep up with the breakneck speed of AI innovation. Consequently, the actual standards for AI governance will emerge organically from industry best practices, born from incident responses and cutting-edge research. These practical solutions will be adopted long before they are codified into law.

The adoption of the AIUC1 standard by leaders in automation (UiPath), customer support (Intercom), and voice (11 Labs) signals an emerging industry-wide consensus on AI agent safety. This is shifting from a one-off certification to a foundational requirement for enterprise readiness, creating a baseline for trust and governance.

Early internet users feared online payments until the HTTPS encryption standard provided a secure, trustworthy process. Similarly, broad AI adoption requires process standards for safety and risk management to build the public and enterprise trust necessary for a boom in the AI-enabled economy.

In regulated industries like finance, the primary barrier to full AI automation is often regulation, not just user trust. It is the technology provider's responsibility to prove AI's reliability and safety to regulators, much like the industry did to legitimize e-signatures over a decade ago.

Security leaders don't wait for government mandates; they adopt market-driven standards like SOC 2 to protect their business and customers. AI governance is following a similar path, with companies establishing robust practices out of necessity, not just for compliance.

As AI systems become foundational to the economy, the market for ensuring they work as intended—through auditing, control, and reliability tools—will explode. This creates a significant venture capital opportunity at the intersection of AI safety-promoting technologies and high-growth business models.

Demis Hassabis argues that market forces will drive AI safety. As enterprises adopt AI agents, their demand for reliability and safety guardrails will commercially penalize 'cowboy operations' that cannot guarantee responsible behavior. This will naturally favor more thoughtful and rigorous AI labs.

An FDA-style regulatory model would force AI companies to make a quantitative safety case for their models before deployment. This shifts the burden of proof from regulators to creators, creating powerful financial incentives for labs to invest heavily in safety research, much like pharmaceutical companies invest in clinical trials.

For AI safety, Demis Hassabis advocates for an international regulatory body, similar to the International Atomic Energy Agency. This body would have technical experts who audit frontier models against agreed-upon benchmarks, checking for undesirable properties like deception and ensuring public confidence through independent verification.