Asking one question didn't just boost Justin Welsh's open rates by 10%. The increased engagement created a virtuous cycle: more replies led to more relevant content, which in turn drove a 20% increase in newsletter referrals and improved email deliverability, as email providers favor two-way communication.
Reading 300-500 email replies weekly is unscalable for a solo creator. Justin Welsh solves this by using an AI tool (Claude) to analyze and bucket the free-form text responses into recurring themes. This transforms a massive, time-consuming data analysis task into a manageable one-hour process, making voice-of-customer research scalable.
By asking one open-ended question in each email, Welsh generates 300-500 replies weekly. He uses the themes and specific problems from these reader responses as the direct source material for his next essay, creating a highly relevant content feedback loop that ensures his content is always what his audience wants.