When building complex AI systems that mediate human interactions, like an AI proctor, start by creating a service map for the ideal human-to-human experience. Define what a great real-world proctor would do and say, then use that blueprint to design the AI's behavior, ensuring it's grounded in human needs.
Related Insights
To build truly effective agents, adopt a "founder's level of service" mindset. This involves an intensive discovery process to become a temporary expert in the client's business, culture, and brand voice. This deep, meticulous care ensures the final AI system is perfectly aligned with the client's intentions.
To discover high-value AI use cases, reframe the problem. Instead of thinking about features, ask, "If my user had a human assistant for this workflow, what tasks would they delegate?" This simple question uncovers powerful opportunities where agents can perform valuable jobs, shifting focus from technology to user value.
When building for AI-powered environments, design tools to be equally usable by humans and the AI model. An elegant, simple design for humans often translates directly into an effective tool for AI agents, simplifying development and promoting shared logic.
Don't view AI tools as just software; treat them like junior team members. Apply management principles: 'hire' the right model for the job (People), define how it should work through structured prompts (Process), and give it a clear, narrow goal (Purpose). This mental model maximizes their effectiveness.
The most effective AI user experiences are skeuomorphic, emulating real-world human interactions. Design an AI onboarding process like you would hire a personal assistant: start with small tasks, verify their work to build trust, and then grant more autonomy and context over time.
A tangible way to implement a "more human" AI strategy is to use automation to free up employee time from repetitive tasks. This saved time should then be deliberately reallocated to high-value, human-centric activities, such as providing personalized customer consultations, that technology cannot replicate.
With AI, designers are no longer just guessing user intent to build static interfaces. Their new primary role is to facilitate the interaction between a user and the AI model, helping users communicate their intent, understand the model's response, and build a trusted relationship with the system.
The most effective way to build a powerful automation prompt is to interview a human expert, document their step-by-step process and decision criteria, and translate that knowledge directly into the AI's instructions. Don't invent; document and translate.
Designers need to get into code faster not just for prototyping, but because the AI model is an active participant in the user experience. You cannot fully design the user's interaction without directly understanding how this non-human "third party" behaves, responds, and affects the outcome.
Instead of writing a traditional spec, the product team at Yelp starts by writing an ideal sample conversation between a user and the AI assistant. This "golden conversation" serves as the primary artifact to work backward from, defining the desired user experience before any technical requirements.
