Anthropic chose not to release its first model, Claude 1, before ChatGPT despite seeing its power. They worried it would trigger a dangerous "arms race" and decided the commercial cost of waiting was worth the potential safety benefit for the world.

Anthropic's safety report states that its automated evaluations for high-level capabilities have become saturated and are no longer useful. They now rely on subjective internal staff surveys to gauge whether a model has crossed critical safety thresholds.

AI lab Anthropic is softening its 'safety-first' stance, ending its practice of halting development on potentially dangerous models. The company states this pivot is necessary to stay competitive with rivals and is a response to the slow pace of federal AI regulation, signaling that market pressures can override foundational principles.

AI leaders aren't ignoring risks because they're malicious, but because they are trapped in a high-stakes competitive race. This "code red" environment incentivizes patching safety issues case-by-case rather than fundamentally re-architecting AI systems to be safe by construction.

Dario Amodei founded Anthropic not just over a different technical vision, but from a core belief that OpenAI, despite its language, lacked a "real and serious conviction" to manage the enormous economic and safety implications of general AI.

A fundamental tension within OpenAI's board was the catch-22 of safety. While some advocated for slowing down, others argued that being too cautious would allow a less scrupulous competitor to achieve AGI first, creating an even greater safety risk for humanity. This paradox fueled internal conflict and justified a rapid development pace.

Known for its cautious approach, Anthropic is pivoting away from its strict AI safety policy. The company will no longer pause development on a model deemed "dangerous" if a competitor releases a comparable one, citing the need to stay competitive and a lack of federal AI regulations.

Departures of senior safety staff from top AI labs highlight a growing internal tension. Employees cite concerns that the pressure to commercialize products and launch features like ads is eroding the original focus on safety and responsible development.

Major AI companies publicly commit to responsible scaling policies but have been observed watering them down before launching new models. This includes lowering security standards, a practice demonstrating how commercial pressures can override safety pledges.