Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

For a rapidly scaling brand, optimizing for small, single-digit percentage gains is a waste of time. Prioritize tests that have the potential for massive, double-digit improvements. If a test doesn't show a clear, significant winner quickly, abandon it and move to the next big idea.

Related Insights

Viral growth isn't luck; it's an iterative process. When a piece of content shows even minor success, immediately abandon your content plan and create a variation on the winning theme. This business-like A/B testing approach magnifies momentum and systematically builds towards parabolic growth.

Jay Schwedelson argues against obsessing over statistical significance in A/B tests, as marketing conditions are too fluid. He suggests focusing on directional data instead. If a test provides 'a little more juice' and moves metrics in the right direction, it's a win worth implementing and building upon.

Modern growth is a high-volume game of testing unique marketing 'angles' to sell one product to many different customer segments. The fastest-growing brands aren't just spending more; they're systematically testing hundreds of angles monthly and scaling the few that resonate.

Founders with low trial volume often mistakenly try to A/B test small changes. With insufficient data, such tests are meaningless. Instead, they should focus on making big, obvious improvements based on gut feel and qualitative feedback. At this stage, the goal isn't optimization; it's finding significant wins that don't require statistical validation.

The potential upside of a successful marketing test is limitless, while the downside of a failure is capped and brief. If all your tests are winning, you are likely only testing obvious optimizations and missing out on bigger, game-changing breakthroughs that come from more ambitious experiments.

For established channels, aim for predictable 10-20% improvements. For new initiatives where no results exist, take bigger risks and set unreasonable goals to chase massive, high-magnitude outcomes. This mental framework avoids applying undue conservatism to unproven, high-potential channels.

A former Optimizely CMO argues that most B2B companies lack the conversion volume to achieve statistical significance on website A/B tests. Teams waste months on inconclusive experiments for marginal gains instead of focusing on bigger strategic bets that actually move the needle.

Before optimizing a poor-performing offer, ask if doubling its performance would make it a success. If a 100% lift still doesn't meet goals, optimization efforts are wasted. It's more effective to discard the offer and create a new one, as incremental tweaks are unlikely to yield more than a 100% improvement.

Top e-commerce brands outpace competitors by operating at a much higher tempo. They use tools like AI to massively increase creative output, testing over 100 ad variations weekly versus a handful, which allows them to discover winning formulas much faster.

Instead of perfecting one funnel, successful brands test a high volume of marketing angles (e.g., 50) with simple static ads. They identify the top performers (e.g., 3-4 "honey holes") and then build out more extensive funnels with video and dedicated landing pages for only those winners.