We scan new podcasts and send you the top 5 insights daily.
Instead of focusing on time saved (e.g., 16 hours/week), the real KPI for executive AI use is expanding 'reach'—the capacity to engage in more strategic areas like competitive intelligence and customer discovery, which were previously impossible to do at scale.
To quantify the real-world impact of its AI tools, Block tracks a simple but powerful metric: "manual hours saved." This KPI combines qualitative and quantitative signals to provide a clear measure of ROI, with a target to save 25% of manual hours across the company.
Unlike traditional software that optimizes for time-in-app, the most successful AI products will be measured by their ability to save users time. The new benchmark for value will be how much cognitive load or manual work is automated "behind the scenes," fundamentally changing the definition of a successful product.
A recent survey reveals a stark disconnect: executives claim massive productivity gains from AI (8-12+ hours/week), while 40% of non-management staff report zero time savings. This highlights a failure in training and personalized use case development for frontline employees.
Measuring AI success requires new metrics. Instead of tracking active usage (e.g., number of meeting summaries), Zoom focuses on deeper engagement, measured by a user's progression from consuming AI output to actively using it to produce valuable new work product like a document or presentation.
With infinitely scalable AI agents, cost and time per interaction are no longer primary constraints. Companies should abandon classic efficiency metrics like Average Handle Time and instead measure success by outcomes, such as percentage of tasks completed and improvements in Customer Satisfaction (CSAT).
Adopting AI hasn't changed core business metrics like growth or retention. Its true value is in operational efficiency, allowing teams to analyze data more deeply. AI provides the ability to explore 'second and third level questions' and investigate previously inaccessible KPIs, improving the *how* without altering the *what*.
Demanding a direct, line-item ROI for foundational AI initiatives is like asking for the ROI on Wi-Fi—it's the wrong question. Instead of getting bogged down in impossible calculations, leaders should focus on measuring the business outcomes enabled by the technology, such as innovation speed or new product creation. Obsess on outcomes, not direct financial return.
The primary ROI of sales AI isn't just saved time, but the reallocation of that time. Evaluate and justify AI tools based on their ability to maximize Customer Facing Time (CFT), as this directly increases both the quantity and quality of customer interactions, leading to better performance.
Instead of abstract productivity metrics, define your AI goal in terms of concrete headcount avoidance. Sensei's objective is to achieve the output of a 700-person company with half the staff by using AI to bridge the gap. This makes the ROI tangible and aligns AI investment with scalable, capital-efficient growth.
According to Mike Cannon-Brookes, advanced enterprises are not tracking AI success by counting tokens. Instead, they are asking harder questions about overall output, such as engineering productivity and quality. They understand that high token usage doesn't always correlate with high productivity, shifting focus from raw usage to tangible business outcomes.