A hidden cause of the reproducibility crisis is how researchers select models like cell lines or mice. The choice is often driven by convenience—what a neighboring lab has available—rather than a systematic evaluation of which model is best suited to answer the specific scientific question.

Michael Shermer argues that phenomena like the replication crisis don't prove science is broken. Instead, the fact that these errors are discovered and publicized by other scientists and lab insiders (like graduate students) demonstrates that science's self-correcting mechanisms are functioning properly.

The 'replication crisis' shows many studies fail to replicate. Researchers, biased by their desire for success, engage in 'p-hacking' and delude themselves into finding significance. Paradoxically, the most surprising and celebrated results are often the least likely to be true.

Gurus often cite legitimate scientific failures to undermine all scientific authority. However, these crises are often caused by a deviation from core scientific principles (e.g., lack of replication). The solution isn't to embrace less rigorous systems but to double down on scientific methods like open science.

The danger of LLMs in research extends beyond simple hallucinations. Because they reference scientific literature—up to 50% of which may be irreproducible in life sciences—they can confidently present and build upon flawed or falsified data, creating a false sense of validity and amplifying the reproducibility crisis.

The public appetite for surprising, "Freakonomics-style" insights creates a powerful incentive for researchers to generate headline-grabbing findings. This pressure can lead to data manipulation and shoddy science, contributing to the replication crisis in social sciences as researchers chase fame and book deals.

Contrary to popular belief, publication in a top academic journal doesn't guarantee a study is correct. The social sciences lack the precise experimental validation of hard sciences, allowing incorrect theories to have "long legs and survive" due to a lack of rigorous, focused scrutiny from peers.

Contrary to popular belief, peer review is not a timeless scientific principle. It was introduced in the mid-1970s, originating from medical billing disputes, and was later adopted to give administrators control over scientific funding and narratives, effectively serving as a tool for enforcing consensus.

The medical field is so culturally ingrained with the belief that only randomized trials can prove causation that journals actively remove causal language (e.g., "X caused Y") from studies using observational data, even from rigorous natural experiments. This belief hinders the adoption of these valuable methods.