A UK startup has found that LLMs can generate accurate, simulated focus group discussions. By creating diverse digital personas, the AI reproduces the nuanced and often surprising feedback that typically requires expensive and slow in-person research, especially in politics.
Anthropic developed an AI tool that conducts automated, adaptive interviews to gather qualitative user feedback. This moves beyond analyzing chat logs to understanding user feelings and experiences, unlocking scalable, in-depth market research, customer success, and even HR applications that were previously impossible.
AI expert Andrej Karpathy suggests treating LLMs as simulators, not entities. Instead of asking, "What do you think?", ask, "What would a group of [relevant experts] say?". This elicits a wider range of simulated perspectives and avoids the biases inherent in forcing the LLM to adopt a single, artificial persona.
The critique that LLMs lack true creativity because they only recombine and predict existing data is challenged by the observation that human creativity, particularly in branding and marketing, often operates on the exact same principles. The process involves combining existing concepts in novel ways to feel fresh, much like an LLM.
A study with Colgate-Palmolive found that large language models can accurately mimic real consumer behavior and purchase intent. This validates the use of "synthetic consumers" for market research, enabling companies to replace costly, slow human surveys with scalable AI personas for faster, richer product feedback.
Expensive user research often sits unused in documents. By ingesting this static data, you can create interactive AI chatbot personas. This allows product and marketing teams to "talk to" their customers in real-time to test ad copy, features, and messaging, making research continuously actionable.
AI models personalize responses based on user history and profile data, including your employer. Asking an LLM what it thinks of your company will result in a biased answer. To get a true picture, marketers must query the AI using synthetic personas that represent their actual target customers.
To create a reliable AI persona, use a two-step process. First, use a constrained tool like Google's NotebookLM, which only uses provided source documents, to distill research into a core prompt. Then, use that fact-based prompt in a general-purpose LLM like ChatGPT to build the final interactive persona.
Instead of manual survey design, provide an AI with a list of hypotheses and context documents. It can generate a complete questionnaire, the platform-specific code file for deployment (e.g., for Qualtrics), and an analysis plan, compressing the user research setup process from days to minutes.
Asking an AI to 'predict' or 'evaluate' for a large sample size (e.g., 100,000 users) fundamentally changes its function. The AI automatically switches from generating generic creative options to providing a statistical simulation. This forces it to go deeper in its research and thinking, yielding more accurate and effective outputs.
Instead of forcing AI to be as deterministic as traditional code, we should embrace its "squishy" nature. Humans have deep-seated biological and social models for dealing with unpredictable, human-like agents, making these systems more intuitive to interact with than rigid software.