Simply stating that conventional wisdom is wrong is a weak "gotcha" tactic. A more robust approach involves investigating the ecosystem that created the belief, specifically the experts who established it, and identifying their incentives or biases, which often reveals why flawed wisdom persists.
The public appetite for surprising, "Freakonomics-style" insights creates a powerful incentive for researchers to generate headline-grabbing findings. This pressure can lead to data manipulation and shoddy science, contributing to the replication crisis in social sciences as researchers chase fame and book deals.
A key feature making economics research robust is its structure. Authors not only present their thesis and evidence but also anticipate and systematically discredit competing theories for the same outcome. This intellectual honesty is a model other social sciences could adopt to improve credibility.
Establishing causation for a complex societal issue requires more than a single data set. The best approach is to build a "collage of evidence." This involves finding natural experiments—like states that enacted a policy before a national ruling—to test the hypothesis under different conditions and strengthen the causal claim.
The famous story of daycare parents arriving later after a fine was introduced is not just about incentives backfiring. Its real purpose was to show that people respond to a mix of financial, moral, and social pressures. Protecting one's reputation can be a stronger motivator than a small monetary penalty.
To cut through rhetoric and assess a claim's validity, ask the direct question: "What is your best evidence that the argument you've just made is true?" The response immediately exposes the foundation of their argument, revealing whether it's baseless, rests on weak anecdotes, or is backed by robust data.