Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The medical field is so culturally ingrained with the belief that only randomized trials can prove causation that journals actively remove causal language (e.g., "X caused Y") from studies using observational data, even from rigorous natural experiments. This belief hinders the adoption of these valuable methods.

Related Insights

Establishing causation for a complex societal issue requires more than a single data set. The best approach is to build a "collage of evidence." This involves finding natural experiments—like states that enacted a policy before a national ruling—to test the hypothesis under different conditions and strengthen the causal claim.

The scientific process relies on replication to verify findings, yet academic journals create a "replication crisis" by prioritizing novelty over truth. They often reject crucial follow-up studies, telling researchers "you already published this finding, so there's nothing novel here," which obstructs the validation of important research.

The most valuable lessons in clinical trial design come from understanding what went wrong. By analyzing the protocols of failed studies, researchers can identify hidden biases, flawed methodologies, and uncontrolled variables, learning precisely what to avoid in their own work.

The scientific gold standard of a placebo-controlled trial creates a profound ethical burden for researchers in neonatal care. To prove a drug's efficacy for widespread use, scientists must knowingly deny the potentially life-saving treatment to half of the fragile infants in a study, forcing them to carry the pain of that decision.

Despite strong observational evidence from Israel suggesting early allergen exposure was beneficial, medical guidelines didn't change. It required the "gold standard" of a randomized controlled trial (the LEAP study) to definitively prove the link and force institutions to formally reverse their harmful avoidance recommendations.

Contrary to popular belief, peer review is not a timeless scientific principle. It was introduced in the mid-1970s, originating from medical billing disputes, and was later adopted to give administrators control over scientific funding and narratives, effectively serving as a tool for enforcing consensus.

A speaker highlights that the Destiny-Breast05 trial (with a survival endpoint) was published in the prestigious New England Journal of Medicine, while the Destiny-Breast11 trial (with a tumor response endpoint) was rejected. This reveals an academic bias where top-tier journals prioritize hard outcomes like survival over surrogate endpoints.

The key public health failure during the pandemic was not initial uncertainty, but the systemic inability to execute rapid experiments. Basic, knowable questions about transmission, masks, and safe distances went unanswered because of a failure to generate data through randomized trials.

To generate reliable findings from real-world data, researchers must avoid data dredging. The best practice is to simulate a 'target trial' by creating a formal protocol with pre-defined inclusion criteria and a statistical plan, mirroring the rigor of a prospective clinical trial. This approach is even guided by the FDA.

Economists developed "natural experiments" to find real-world situations that mimic randomized trials. This approach, where otherwise identical groups receive different "treatments" by chance, can establish causality from observational data. It represents a powerful but underutilized tool for medical research beyond traditional, expensive trials.

Medical Journals Systematically Strip Causal Language From Non-Randomized Studies | RiffOn