Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The system of cheap labor, AI drafting, and fake accounts is topic-agnostic. It was built for commercial purposes but can be easily repurposed for malicious intent. The machine doesn't care if it's amplifying a product launch or state-sponsored disinformation; it just works.

Related Insights

National AI strategies that prioritize ideology over objective truth are actively training AI models to lie by omission or commission. This weaponizes AI against citizens, as the lies become invisible and integrated into the tools people use to interpret the world, posing a significant societal threat.

Unlike historical propaganda which used centralized broadcasts, today's narrative control is decentralized and subtle. It operates through billions of micro-decisions and algorithmic nudges that shape individual perceptions daily, achieving macro-level control without any overt displays of power.

With over half of long-form LinkedIn posts being AI-generated and engagement being faked by bots and coordinated groups, metrics like likes and generic comments ('so true') are no longer reliable indicators of audience agreement or content quality. Treat it as manufactured volume, not proof.

The strategy of using cheap human labor combined with AI to manufacture posts and fake engagement is the same recipe used by state actors to manipulate public opinion online. The only difference is the initial intent: selling 'humblebrags' versus eroding democracy.

The modern information landscape is saturated with AI-generated propaganda from all sides. It is no longer sufficient to be skeptical of foreign adversaries; one must actively question and verify information from domestic governments as well, as all parties use these tools to shape narratives.

A content moderation failure revealed a sophisticated misuse tactic: campaigns used factually correct but emotionally charged information (e.g., school shooting statistics) not to misinform, but to intentionally polarize audiences and incite conflict. This challenges traditional definitions of harmful content.

Extremist figures are not organic phenomena but are actively amplified by social media algorithms that prioritize incendiary content for engagement. This process elevates noxious ideas far beyond their natural reach, effectively manufacturing influence for profit and normalizing extremism.

The online world, particularly platforms like the former Twitter, is not a true reflection of the real world. A small percentage of users, many of whom are bots, generate the vast majority of content. This creates a distorted and often overly negative perception of public sentiment that does not represent the majority view.

While deepfakes garner attention, research from as early as 2020 shows AI can measurably change political opinions using only simple text. This scalable, text-based persuasion is a potent tool for information operations that may be more impactful than more technologically complex manipulations.

Before ChatGPT, humanity's "first contact" with rogue AI was social media. These simple, narrow AIs optimizing solely for engagement were powerful enough to degrade mental health and democracy. This "baby AI" serves as a stark warning for the societal impact of more advanced, general AI systems.