To ensure reliability in healthcare, ZocDoc doesn't give LLMs free rein. It wraps them in a hybrid system where traditional, deterministic code orchestrates the AI's tasks, sets firm boundaries, and knows when to hand off to a human, preventing the 'praying for the best' approach common with direct LLM use.

Related Insights

Contrary to the vision of free-wheeling autonomous agents, most business automation relies on strict Standard Operating Procedures (SOPs). Products like OpenAI's Agent Builder succeed by providing deterministic, node-based workflows that enforce business logic, which is more valuable than pure autonomy.

To avoid AI hallucinations, Square's AI tools translate merchant queries into deterministic actions. For example, a query about sales on rainy days prompts the AI to write and execute real SQL code against a data warehouse, ensuring grounded, accurate results.

Frame AI independence like self-driving car levels: 'Human-in-the-loop' (AI as advisor), 'Human-on-the-loop' (AI acts with supervision), and 'Human-out-of-the-loop' (full autonomy). This tiered model allows organizations to match the level of AI independence to the specific risk of the task.

Use a two-axis framework to determine if a human-in-the-loop is needed. If the AI is highly competent and the task is low-stakes (e.g., internal competitor tracking), full autonomy is fine. For high-stakes tasks (e.g., customer emails), human review is essential, even if the AI is good.

Instead of waiting for AI models to be perfect, design your application from the start to allow for human correction. This pragmatic approach acknowledges AI's inherent uncertainty and allows you to deliver value sooner by leveraging human oversight to handle edge cases.

High productivity isn't about using AI for everything. It's a disciplined workflow: breaking a task into sub-problems, using an LLM for high-leverage parts like scaffolding and tests, and reserving human focus for the core implementation. This avoids the sunk cost of forcing AI on unsuitable tasks.

Building features like custom commands and sub-agents can look like reliable, deterministic workflows. However, because they are built on non-deterministic LLMs, they fail unpredictably. This misleads users into trusting a fragile abstraction and ultimately results in a poor experience.

The most effective use of AI isn't full automation, but "hybrid intelligence." This framework ensures humans always remain central to the decision-making process, with AI serving in a complementary, supporting role to augment human intuition and strategy.

Unlike Claude Projects where the LLM decides how to use tools, Skills execute predefined scripts. This gives users precise control over data analysis and repeatable tasks, ensuring consistent, accurate results and overcoming the common issue of non-deterministic AI outputs.

Instead of simply automating jobs, ZocDoc's AI redesigns the entire patient intake process. It triages calls, routing simple queries to an AI and complex ones to the most qualified human specialist. This transforms a cost center into a highly efficient system that improves the patient experience.