Traditional vehicle safety (e.g., Euro NCAP) used a checklist of specific test cases with binary pass/fail answers. For AI systems, this is insufficient. The new paradigm is statistical validation, where the goal is to prove reliability to a certain number of "nines" across a vast range of scenarios.

Unlike typical tech development that focuses on capabilities first, Waymo embeds safety as a "non-negotiable foundation" from the start. This means building safety into the model architecture and team mindset, as the approach to achieving 90% performance is fundamentally different from reaching the final "nines" of reliability.

NVIDIA's next-generation autonomous driving models will incorporate language, allowing them to reason through driving scenarios verbally. A user could ask the car why it is making a certain move, and the multimodal model, which combines vision and language, will explain its thought process in real time.

To address safety concerns of an end-to-end "black box" self-driving AI, NVIDIA runs it in parallel with a traditional, transparent software stack. A "safety policy evaluator" then decides which system to trust at any moment, providing a fallback to a more predictable system in uncertain scenarios.

NVIDIA is releasing an open-source, end-to-end AI software and hardware stack for autonomous driving. This strategy mimics Google's Android playbook: by enabling any automaker to build self-driving cars, NVIDIA aims to sell more of its onboard computers and dominate the chip market.

Rivian's CEO explains that early autonomous systems, which were based on rigid rules-based "planners," have been superseded by end-to-end AI. This new approach uses a large "foundation model for driving" that can improve continuously with more data, breaking through the performance plateau of the older method.

A pure "pixels-in, actions-out" model is insufficient for full autonomy. While easy to start, this approach is extremely inefficient to simulate and validate for safety-critical edge cases. Waymo augments its end-to-end system with intermediate representations (like objects and road signs) to make simulation and validation tractable.

A "vanilla" end-to-end model is insufficient for safety-critical systems. Waymo's foundation model is end-to-end but is augmented with "structured materialized intermediate representation." This allows for crucial runtime validation, richer training, and closed-loop evaluation necessary for superhuman performance at scale.

NVIDIA conceptualizes the AV challenge around three distinct computing pillars: a training computer for models, a simulation computer for validation, and an in-car inference computer for real-time decisions. This framework highlights the massive, multi-faceted compute investment required for full autonomy.