Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Tech firms are often reluctant to make and own controversial decisions about who to deplatform. They prefer receiving a "list of the Nazis" from an external organization, allowing them to act without taking direct responsibility for the decision, effectively outsourcing the moral and political liability.

Related Insights

Major companies like Amazon and financial service providers have integrated the SPLC's 'extremist' list into their compliance pipelines. In some cases, this authority is delegated, meaning a listing by the SPLC can automatically kill a transaction or account application as cleanly as an official government sanction.

Similar to the financial sector, tech companies are increasingly pressured to act as a de facto arm of the government, particularly on issues like censorship. This has led to a power struggle, with some tech leaders now publicly pre-committing to resist future government requests.

As major platforms abdicate trust and safety responsibilities, demand grows for user-centric solutions. This fuels interest in decentralized networks and "middleware" that empower communities to set their own content standards, a move away from centralized, top-down platform moderation.

When direct censorship is unconstitutional, governments pressure intermediaries like tech companies, banks, or funded NGOs to suppress speech. These risk-averse middlemen comply to stay in the government's good graces, effectively doing the state's dirty work.

Using the example of ISIS-posted execution photos, Costolo illustrates why rigid content moderation rules are impossible. When the New York Post published the same photo that got terrorist accounts suspended, it showed that context and speaker identity demand subjective judgment, not a simple rules engine.

Unanimous corporate actions, like Trump's deplatforming, are driven by game theory. The catastrophic business and political risk of being the sole holdout creates a 'race-to-be-second,' where one company's move pressures all others to follow immediately to avoid isolation.

Companies like Facebook and YouTube feign precise control, but their use of blunt instruments—like banning all political ads or disabling all comments on certain videos—proves they can't manage content at a micro level and are struggling with the chaos of their own systems.

A coalition first secured companies' agreement to deplatform genuinely harmful actors like terrorists (the 'ante'). They then expanded demands to include controversial political figures (the 'raise'), framing non-compliance as a failure to uphold the original commitment.

The Trust & Safety field, once a powerful internal voice for user rights and ethical principles, has been systematically weakened. To appease political pressures, tech companies have pushed out vocal advocates, reducing the role to a mere compliance function and leaving platform governance to the whims of their leaders.

The idea that tech companies will ruthlessly optimize AI for user addiction is flawed. Their primary goal is avoiding societal, political, and regulatory backlash. The biggest myth is that companies exist to maximize profits; their top priority is avoiding being "lit on fire" by public outrage.