Anthropic's CEO clarified the company opposes a blanket ban on open-weight AI. Instead, he proposed targeted actions: sanctioning chip sales to China, cracking down on 'industrial-scale distillation' (IP theft) of proprietary models, and mandating safety testing for all highly capable models, both open and closed.

AI lab Anthropic is softening its 'safety-first' stance, ending its practice of halting development on potentially dangerous models. The company states this pivot is necessary to stay competitive with rivals and is a response to the slow pace of federal AI regulation, signaling that market pressures can override foundational principles.

Anthropic's public stance advocating for a regulatory approval process for AI models, while framed around safety, could create a competitive moat. This strategy leverages political concerns about AI danger and China to potentially establish a de facto ban on open-weight models, benefiting their closed-model business.

Dario Amodei founded Anthropic not just over a different technical vision, but from a core belief that OpenAI, despite its language, lacked a "real and serious conviction" to manage the enormous economic and safety implications of general AI.

Known for its cautious approach, Anthropic is pivoting away from its strict AI safety policy. The company will no longer pause development on a model deemed "dangerous" if a competitor releases a comparable one, citing the need to stay competitive and a lack of federal AI regulations.

NVIDIA's CEO Jensen Huang argues that closed AI models create single points of failure and concentrate risk. True AI safety emerges from open-weight models, where a broad community of researchers can inspect, 'red team,' and fix vulnerabilities, making transparency more secure than obscurity.

While nearly every major tech company has signed on to support open-weight AI, Anthropic remains the sole, vocal opponent. Their stance is rooted in safety, arguing that releasing powerful, uncontrollable models poses an unacceptable risk, a position that now pits them against the entire industry consensus.

Anthropic's CEO clarified his stance is not for banning open-weight AI models. Instead, he advocates for specific policies like enforcing chip export controls, stopping large-scale model distillation, and requiring safety testing for all powerful models, both open and closed. This is a more nuanced position than a simple pro-regulation stance.

After revising its Responsible Scaling Policy, Anthropic's effective stance on safety is no longer about hard, unbreakable commitments. Instead, it's an implicit request for the public and stakeholders to trust the team's judgment and goodwill. Their actual policy is that they will seriously investigate risks and then use their best judgment, asking to be judged by their actions.