The AI systems used for mass censorship were not created for social media. They began as military and intelligence projects (DARPA, CIA, NSA) to track terrorists and foreign threats, then were pivoted to target domestic political narratives after the 2016 election.
AI provides a structural advantage to those in power by automating government systems. This allows leaders to bypass the traditional unwieldiness of human bureaucracy, making it trivial for an executive to change AI parameters and instantly exert their will across all levels of government, thereby concentrating power.
The justification for accelerating AI development to beat China is logically flawed. It assumes the victor wields a controllable tool. In reality, both nations are racing to build the same uncontrollable AI, making the race itself, not the competitor, the primary existential threat.
We are months away from AI that can create a media feed designed to exclusively validate a user's worldview while ignoring all contradictory information. This will intensify confirmation bias to an extreme, making rational debate impossible as individuals inhabit completely separate, self-reinforced realities with no common ground or shared facts.
Before generative AI, the simple algorithms optimizing newsfeeds for engagement acted as a powerful, yet misaligned, "baby AI." This narrow system, pointed at the human brain, was potent enough to create widespread anxiety, depression, and polarization by prioritizing attention over well-being.
AI's integration into democracy isn't happening through top-down mandates but via individual actors like city councilors and judges. They can use AI tools for tasks like drafting bills or interpreting laws without seeking permission, leading to rapid, unregulated adoption in areas with low public visibility.
To circumvent First Amendment protections, the national security state framed unwanted domestic political speech as a "foreign influence operation." This national security justification was the legal hammer used to involve agencies like the CIA in moderating content on domestic social media platforms.
High-level US military and intelligence figures see independent online voices as a primary geopolitical threat. They fear that uncontrolled narratives can foster nationalism (like Brexit), which could lead to the dissolution of key alliances like the EU and NATO, disrupting the established world order.
While making powerful AI open-source creates risks from rogue actors, it is preferable to centralized control by a single entity. Widespread access acts as a deterrent based on mutually assured destruction, preventing any one group from using AI as a tool for absolute power.
Before ChatGPT, humanity's "first contact" with rogue AI was social media. These simple, narrow AIs optimizing solely for engagement were powerful enough to degrade mental health and democracy. This "baby AI" serves as a stark warning for the societal impact of more advanced, general AI systems.
The modern concentration of media power isn't a recent phenomenon. It was formalized during WWII when the Pentagon centralized control over radio, print, and Hollywood for propaganda purposes. This government-media relationship persisted and expanded through Cold War intelligence operations like Project Mockingbird.