Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

When evaluating a backtest, investors should distrust any model that shows impressive returns without also revealing why the strategy is incredibly difficult to implement. A believable backtest must demonstrate the associated pain, such as long periods of underperformance or high career risk, which explains why the potential for future returns exists.

Related Insights

During due diligence, it's crucial to look beyond returns. Top allocators analyze a manager's decision-making process, not just the outcome. They penalize managers who were “right for the wrong reasons” (luck) and give credit to those who were “wrong for the right reasons” (good process, bad luck).

Advice from successful people is inherently flawed because it ignores the role of luck and timing. A more accurate approach is to study failures—the metaphorical planes that didn't return. Understanding why most people *don't* succeed provides a more robust framework for navigating risk than simply copying a survivor's path.

When evaluating others' success, ask if their strategy would work for most people who adopt it, or if it relied heavily on luck. If a strategy isn't reproducible and leaves many casualties behind, it's not a model to be learned from, regardless of the impressive outlier outcome.

People justify high-risk strategies by retroactively fitting themselves into a successful subgroup (e.g., 'Yes, most investors fail, but *smart* ones succeed, and I am smart'). This is 'hindsight gerrymandering'—using a trait like 'smartness,' which can only be proven after the fact, to create a biased sample and rationalize the risk.

To combat survivorship bias, a robust trading strategy must be continuously tested against reality. Alex Gurevich’s approach involves republishing his original book with new annotations detailing where his principles succeeded and, more importantly, where they failed, creating an 'intellectual cockpit' for readers.

A key challenge of adopting ML in investing is its lack of explainability. When a traditional value strategy underperforms, you can point to a valuation bubble. An ML model can't offer a similar narrative, making it extremely difficult to manage client relationships during drawdowns because the 'why' is missing.

Backtests and research from asset management firms that sell the related product are inherently biased. Similar to drug studies sponsored by pharmaceutical companies, the incentive is to create a favorable outcome. Investors should heavily discount such research and seek less biased evidence from sources like academic journals.

Before committing capital, professional investors rigorously challenge their own assumptions. They actively ask, "If I'm wrong, why?" This process of stress-testing an idea helps avoid costly mistakes and strengthens the final thesis.

A core discipline from risk arbitrage is to precisely understand and quantify the potential downside before investing. By knowing exactly 'why we're going to lose money' and what that loss looks like, investors can better set probabilities and make more disciplined, unemotional decisions.

Historical analysis of investors like Ben Graham and Charlie Munger reveals a consistent pattern: significant, multi-year periods of lagging the market are not an anomaly but a necessary part of a successful long-term strategy. This reality demands structuring your firm and mindset for inevitable pain.