AI models tend to be overly optimistic. To get a balanced market analysis, explicitly instruct AI research tools like Perplexity to act as a "devil's advocate." This helps uncover risks, challenge assumptions, and makes it easier for product managers to say "no" to weak ideas quickly.

Related Insights

Product managers should leverage AI to get 80% of the way on tasks like competitive analysis, but must apply their own intellect for the final 20%. Fully abdicating responsibility to AI can lead to factual errors and hallucinations that, if used to build a product, result in costly rework and strategic missteps.

A powerful workflow is to explicitly instruct your AI to act as a collaborative thinking partner—asking questions and organizing thoughts—while strictly forbidding it from creating final artifacts. This separates the crucial thinking phase from the generative phase, leading to better outcomes.

Treat advanced AI systems not as software with binary outcomes, but as a new employee with a unique persona. They can offer diverse, non-obvious insights and a different "chain of thought," sometimes finding issues even human experts miss and providing complementary perspectives.

Go beyond using AI for data synthesis. Leverage it as a critical partner to stress-test your strategic opinions and assumptions. AI can challenge your thinking, identify conflicts in your data, and help you refine your point of view, ultimately hardening your final plan.

Treat AI as a critique partner. After synthesizing research, explain your takeaways and then ask the AI to analyze the same raw data to report on patterns, themes, or conclusions you didn't mention. This is a powerful method for revealing analytical blind spots.

To effectively leverage AI, treat it as a new team member. Take its suggestions seriously and give it the best opportunity to contribute. However, just like with a human colleague, you must apply a critical filter, question its output, and ultimately remain accountable for the final result.

Instead of just asking an AI to write a PRD, first provide it with a "Socratic questioning" template. The LLM will then act as a thinking partner, asking challenging, open-ended questions about the problem and solution. This upfront thinking process results in a significantly more robust final document.

To truly validate their idea, Moonshot AI's founders deliberately sought negative feedback. This approach of "trying to get the no's" ensures honest market signals, helping them avoid the trap of false positive validation from contacts who are just being polite.

Standard AI models are often overly supportive. To get genuine, valuable feedback, explicitly instruct your AI to act as a critical thought partner. Use prompts like "push back on things" and "feel free to challenge me" to break the AI's default agreeableness and turn it into a true sparring partner.

Asking an AI to 'predict' or 'evaluate' for a large sample size (e.g., 100,000 users) fundamentally changes its function. The AI automatically switches from generating generic creative options to providing a statistical simulation. This forces it to go deeper in its research and thinking, yielding more accurate and effective outputs.

Prompt AI to Play "Devil's Advocate" to Overcome Confirmation Bias | RiffOn