Top Chinese officials use the metaphor "if the braking system isn't under control, you can't really step on the accelerator with confidence." This reflects a core belief that robust safety measures enable, rather than hinder, the aggressive development and deployment of powerful AI systems, viewing the two as synergistic.

Establishing a significant AI lead over autocratic rivals is not just for geopolitical dominance. It is a strategic tool that affords democracies the luxury to prioritize safety, ethics, and trust. This lead prevents a "race to the bottom" where both sides might irresponsibly cut corners on safety.

Like early electricity, which caused fires and electrocutions, AI is a powerful, scary, and poorly understood technology. The historical process of making electricity safe through standards for measurement (Volts, Amps, Ohms) and devices (fuses) provides a clear roadmap for governing AI risks.

Instead of only slowing down risky AI, a key strategy is to accelerate beneficial technologies like decision-making tools. This 'differential technology development' aims to equip humanity with better cognitive tools before the most dangerous AI capabilities emerge, improving our odds of a safe transition.

AI accelerationists and safety advocates often appear to have opposing goals, but may actually desire a similar 10-20 year transition period. The conflict arises because accelerationists believe the default timeline is 50-100 years and want to speed it up, while safety advocates believe the default is an explosive 1-5 years and want to slow it down.

Ryan Kidd argues that it's nearly impossible to separate AI safety and capabilities work. Safety improvements, like RLHF, make models more useful and steerable, which in turn accelerates demand for more powerful "engines." This suggests that pure "safety-only" research is a practical impossibility.

AI will create negative consequences, like the internet spawned the dark web. However, its potential to solve major problems like disease and energy scarcity makes its development a net positive for society, justifying the risks that must be managed along the way.

An FDA-style regulatory model would force AI companies to make a quantitative safety case for their models before deployment. This shifts the burden of proof from regulators to creators, creating powerful financial incentives for labs to invest heavily in safety research, much like pharmaceutical companies invest in clinical trials.

The approach to AI safety isn't new; it mirrors historical solutions for managing technological risk. Just as Benjamin Franklin's 18th-century fire insurance company created building codes and inspections to reduce fires, a modern AI insurance market can drive the creation and adoption of safety standards and audits for AI agents.