Unlike other business areas, contact centers have highly sophisticated, pre-existing metrics (like average handle time). This allows businesses to apply the same measurement tools to AI agents, enabling a direct and precise comparison of performance, cost, and overall effectiveness against human counterparts.

Related Insights

To quantify the real-world impact of its AI tools, Block tracks a simple but powerful metric: "manual hours saved." This KPI combines qualitative and quantitative signals to provide a clear measure of ROI, with a target to save 25% of manual hours across the company.

Unlike traditional software that optimizes for time-in-app, the most successful AI products will be measured by their ability to save users time. The new benchmark for value will be how much cognitive load or manual work is automated "behind the scenes," fundamentally changing the definition of a successful product.

Companies aren't using AI to cut staff but to handle routine tasks, allowing agents to manage complex, emotional issues. This transforms the agent's role from transactional support to high-value relationship management, requiring more empathy and problem-solving skills, not less.

Traditional product metrics like DAU are meaningless for autonomous AI agents that operate without user interaction. Product teams must redefine success by focusing on tangible business outcomes. Instead of tracking agent usage, measure "support tickets automatically closed" or "workflows completed."

DBS quantifies the ROI of its AI by tracking revenue generated from A/B tested customer "nudges." This practical application, which yielded $750 million, provides a direct feedback loop on whether AI-driven offers are effective, moving beyond simple efficiency metrics to prove top-line growth.

The most significant near-term impact of voice AI will be in call centers. Rather than simply replacing agents, the technology will first elevate their effectiveness and productivity. Concurrently, voice bots will handle initial queries, solving the common pain point of long wait times and improving overall customer experience.

Open and click rates are ineffective for measuring AI-driven, two-way conversations. Instead, leaders should adopt new KPIs: outcome metrics (e.g., meetings booked), conversational quality (tracking an agent's 'I don't know' rate to measure trust), and, ultimately, customer lifetime value.

AI voice isn't just about cost savings. The technology has improved so much that it often provides a better customer experience (NPS) than human agents. This dual benefit of high ROI and improved experience means customers are eagerly adopting these solutions, creating a powerful market pull for founders.

For companies wondering where to start with AI, target the most labor-intensive, process-driven functions. Customer support is an ideal starting point, as AI can handle repetitive tasks, leading to lower costs, faster response times, and an improved customer experience while freeing up human agents for more complex issues.

AI can move from diagnosis to prescription. After identifying an underperforming metric (e.g., low close rate in a city), it can generate a specific action plan, frame suggestions by effort and impact, and even calculate the projected revenue impact of reaching the performance benchmark.