Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Daryl Bem's 2011 paper 'proving' ESP was a key trigger for psychology's replication crisis. Because it followed the field's accepted statistical practices (p-hacking) to reach an absurd conclusion, it forced a dilemma: either ESP is real, or the field's methods are fundamentally unreliable.

Related Insights

Michael Shermer argues that phenomena like the replication crisis don't prove science is broken. Instead, the fact that these errors are discovered and publicized by other scientists and lab insiders (like graduate students) demonstrates that science's self-correcting mechanisms are functioning properly.

The 'replication crisis' shows many studies fail to replicate. Researchers, biased by their desire for success, engage in 'p-hacking' and delude themselves into finding significance. Paradoxically, the most surprising and celebrated results are often the least likely to be true.

After spending two months and 35 experiments disproving a popular research direction, the authors published their negative results to save others from the same fate. They advocate for simple, rigorous controls that would have prevented the false positives they chased, highlighting the immense value of transparently sharing what doesn't work.

Gurus often cite legitimate scientific failures to undermine all scientific authority. However, these crises are often caused by a deviation from core scientific principles (e.g., lack of replication). The solution isn't to embrace less rigorous systems but to double down on scientific methods like open science.

The public appetite for surprising, "Freakonomics-style" insights creates a powerful incentive for researchers to generate headline-grabbing findings. This pressure can lead to data manipulation and shoddy science, contributing to the replication crisis in social sciences as researchers chase fame and book deals.

The famous study where priming with 'elderly' words made people walk slower is now seen as an emblem of a failed research program. This area of social priming collapsed under scrutiny due to small sample sizes, a failure to replicate, and the inherent implausibility of the claimed effects.

Psychological science often mistakenly assumes that group averages can predict an individual's development over time. This statistical error, known as violating ergodicity, means many common psychological concepts and traits don't accurately describe any single person's life journey.

Contrary to popular belief, publication in a top academic journal doesn't guarantee a study is correct. The social sciences lack the precise experimental validation of hard sciences, allowing incorrect theories to have "long legs and survive" due to a lack of rigorous, focused scrutiny from peers.

Amidst psychology's replication crisis, the Stroop effect stands out as an exceptionally robust and reliable finding. The cognitive interference felt when trying to name the ink color of a mismatched color word is so powerful and easy to demonstrate that it's seen as a bedrock truth of the field.

Once-popular concepts like psychological "priming" have been largely disproven through replication studies. A reliable rule for marketers is that if a psychological input is ridiculously small and barely noticeable, it is unlikely to produce a significant or repeatable behavioral change.

Daryl Bem's ESP Study Sparked the Replication Crisis By Exposing Flawed Research Methods | RiffOn