The 'replication crisis' shows many studies fail to replicate. Researchers, biased by their desire for success, engage in 'p-hacking' and delude themselves into finding significance. Paradoxically, the most surprising and celebrated results are often the least likely to be true.

Daryl Bem's 2011 paper 'proving' ESP was a key trigger for psychology's replication crisis. Because it followed the field's accepted statistical practices (p-hacking) to reach an absurd conclusion, it forced a dilemma: either ESP is real, or the field's methods are fundamentally unreliable.

The "Batman Effect" study's choice of a superhero to test a "disruption" hypothesis introduces a glaring confound (priming heroism). This may be a deliberate strategy to create ambiguity, ensuring a stream of follow-up studies is needed to disentangle the effects, thus building a literature.

A psychology study's attempt to measure "state disinhibition" by assessing "bystander apathy" is highlighted as a convoluted and meaningless methodological leap. This shows how academic research can become detached from common sense in its pursuit of novel metrics.

Invoking 'studies say' or 'science backed' has become a rhetorical trick to claim intellectual authority and shut down conversation. It's wiser to adopt a default position of skepticism, as these phrases often precede weak or misrepresented claims, especially in soft sciences.

The podcast critiques a study where a 'mock dating app' swipe is presented as a behavioral measure. This is seen as a superficial attempt to address criticism, as swiping on a fake profile is functionally the same as checking a box, not a real-world action.

The public appetite for surprising, "Freakonomics-style" insights creates a powerful incentive for researchers to generate headline-grabbing findings. This pressure can lead to data manipulation and shoddy science, contributing to the replication crisis in social sciences as researchers chase fame and book deals.

Contrary to popular belief, publication in a top academic journal doesn't guarantee a study is correct. The social sciences lack the precise experimental validation of hard sciences, allowing incorrect theories to have "long legs and survive" due to a lack of rigorous, focused scrutiny from peers.

Once-popular concepts like psychological "priming" have been largely disproven through replication studies. A reliable rule for marketers is that if a psychological input is ridiculously small and barely noticeable, it is unlikely to produce a significant or repeatable behavioral change.