Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Social media algorithms optimize for engagement, often amplifying divisive content. In contrast, LLMs must optimize for accuracy and truth to retain user trust. This fundamentally different business model positions LLMs as a potential societal antidote to algorithmic polarization.

Related Insights

Social media algorithms amplify negativity by optimizing for "revealed preference" (what you click on, e.g., car crashes). AI models, however, operate on aspirational choice (what you explicitly ask for). This fundamental difference means AI can reflect a more complex and wholesome version of humanity.

The feeling of deep societal division is an artifact of platform design. Algorithms amplify extreme voices because they generate engagement, creating a false impression of widespread polarization. In reality, without these amplified voices, most people's views on contentious topics are quite moderate.

The traditional goal of winning hearts and minds is now a two-step process. Marketers must first win over the "machines"—search algorithms and LLMs—that control 85% of content discovery, treating them as an influential, gatekeeping audience.

Instead of reactively debunking false narratives, brands can "pre-bunk" them by making verifiable information readily available to large language models. This proactive approach conditions the AI with the truth before a crisis, making it less susceptible to spreading misinformation.

Unlike social media algorithms that can push users toward extreme content, AI chatbots are generally programmed to be normalizing. They steer conversations away from conspiracy theories and reinforce mainstream perspectives, providing a potential psychological counterbalance.

To introduce ads into ChatGPT, OpenAI plans a technical 'firewall' ensuring the LLM generating answers is unaware of advertisers. This separation, akin to the editorial/sales divide in media, is a critical product decision designed to maintain user trust by preventing ads from influencing the AI's core responses.

The genius of X's Community Notes algorithm is that it surfaces a fact-check only when users from opposing ideological viewpoints agree on its validity. This mechanism actively filters for non-partisan, consensus-based truth rather than relying on biased fact-checkers.

If the AI community prioritizes truth-seeking over persuasive-sounding outputs, it could create a virtuous cycle. A more truth-seeking AI would better identify the most important interventions to improve its own reasoning, leading to a feedback loop that rapidly enhances epistemic quality.

As social media and search results become saturated with low-quality, AI-generated content (dubbed "slop"), users may develop a stronger preference for reliable information. This "sloptimism" suggests the degradation of the online ecosystem could inadvertently drive a rebound in trust for established, human-curated news organizations as a defense against misinformation.

AI can be deployed to systematically dismantle dishonest arguments online. By providing rational, well-structured explanations on demand, AI agents can serve as a powerful tool to de-escalate outrage cycles and enforce a higher standard of discourse.

LLMs' "Truth-Seeking" Business Model Can Counter Social Media's Polarization | RiffOn