By default, AI models are designed to be agreeable. To get true value, explicitly instruct the AI to act as a critic or 'devil's advocate.' Ask it to challenge your assumptions and list potential risks. This exposes blind spots and leads to stronger, more resilient strategies than you would develop with a simple 'yes-man' assistant.

When a mathematical optimization model is "infeasible," it's not a failure. It's a valuable diagnostic tool that proves a set of business rules, budgets, or constraints are fundamentally in conflict and cannot all be satisfied simultaneously. This forces clarification of priorities.

AI performs poorly in areas where expertise is based on unwritten 'taste' or intuition rather than documented knowledge. If the correct approach doesn't exist in training data or isn't explicitly provided by human trainers, models will inevitably struggle with that particular problem.

The key skill for an AI PM is knowing a model's current capabilities. This is built by intensely using the model and, crucially, asking it to introspect on its own unexpected behaviors to understand *why* it made a mistake, revealing gaps to fix.

Product managers may lack the expertise to create comprehensive evals from scratch. A better approach is to generate initial outputs with a base model, have subject matter experts review them, and use their direct feedback to define what constitutes a failure. It's easier for experts to spot mistakes than to predict them.

Teams often build financial models to confirm their enthusiasm for a particular AI initiative. However, the model's greatest value comes from rigorously challenging these assumptions. Often, the most hyped projects are revealed to have a fraction of the financial impact of less visible but more strategic alternatives.

An effective method for refining AI output is to instruct the model to adopt an expert persona, such as a "PhD economist," and critically evaluate its own work. This often leads the model to self-identify and correct its own flaws without further prompting.

AI models tend to be overly optimistic. To get a balanced market analysis, explicitly instruct AI research tools like Perplexity to act as a "devil's advocate." This helps uncover risks, challenge assumptions, and makes it easier for product managers to say "no" to weak ideas quickly.

AI models lack novel context and frequently produce errors. The success of an AI-first product hinges on leveraging domain experts to build the model's "muscle," provide essential context, and constantly validate its output to ensure accuracy and value.