Counterintuitively, the path to full automation isn't just analyzing conversation transcripts. Cresta's CEO found that you must first observe and instrument what human agents are doing on their desktops—navigating legacy systems and UIs—to truly understand and automate the complete workflow.
Contrary to the vision of free-wheeling autonomous agents, most business automation relies on strict Standard Operating Procedures (SOPs). Products like OpenAI's Agent Builder succeed by providing deterministic, node-based workflows that enforce business logic, which is more valuable than pure autonomy.
To successfully automate complex workflows with AI, product teams must go beyond traditional discovery. A "forward-deployed PM" works on-site with customers, directly observing workflows and tweaking AI parameters like context windows and embeddings in real-time to achieve flawless automation.
To discover high-value AI use cases, reframe the problem. Instead of thinking about features, ask, "If my user had a human assistant for this workflow, what tasks would they delegate?" This simple question uncovers powerful opportunities where agents can perform valuable jobs, shifting focus from technology to user value.
A critical error in AI integration is automating existing, often clunky, processes. Instead, companies should use AI as an opportunity to fundamentally rethink and redesign workflows from the ground up to achieve the desired outcome in a more efficient and customer-centric way.
While AI efficiently transcribes user interviews, true customer insight comes from ethnographic research—observing users in their natural environment. What people say is often different from their actual behavior. Don't let AI tools create a false sense of understanding that replaces direct observation.
Enterprises are trapped by decades of undocumented code. Rather than ripping and replacing, agentic AI can analyze and understand these complex systems. This enables redesign from the inside out and modernizes the core of the business, bridging the gap between business and IT.
The most effective way to build a powerful automation prompt is to interview a human expert, document their step-by-step process and decision criteria, and translate that knowledge directly into the AI's instructions. Don't invent; document and translate.
Reviewing user interaction data is the highest ROI activity for improving an AI product. Instead of relying solely on third-party observability tools, high-performing teams build simple, custom internal applications. These tools are tailored to their specific data and workflow, removing all friction from the process of looking at and annotating traces.
When developing AI capabilities, focus on creating agents that each perform one task exceptionally well, like call analysis or objection identification. These specialized agents can then be connected in a platform like Microsoft's Copilot Studio to create powerful, automated workflows.
To build an effective AI product, founders should first perform the service manually. This direct interaction reveals nuanced user needs, providing an essential blueprint for designing AI that successfully replaces the human process and avoids building a tool that misses the mark.