The key measure of leverage for AI-powered developers is no longer GPU utilization (FLOPs) but the volume of tokens processed by agents. Karpathy feels nervous when his token subscriptions are underutilized, indicating he's the bottleneck, not the system.

To quantify the real-world impact of its AI tools, Block tracks a simple but powerful metric: "manual hours saved." This KPI combines qualitative and quantitative signals to provide a clear measure of ROI, with a target to save 25% of manual hours across the company.

The team managing Composio's AI pipeline for building tool integrations spends more on LLM tokens than on salaries for its engineers. This signals a new economic reality for AI-native companies where compute is a larger operational cost than labor.

A simple framework to estimate AI's current economic impact multiplies three key metrics: the percentage of workers using AI (~40%), their weekly usage intensity (~2 hours), and the average task efficiency gain (15-30%). This calculation reveals a modest but tangible current productivity increase.

Howie Lu advises against anchoring AI costs to cheap software subscriptions. Instead, evaluate token costs against the opportunity cost of an equivalent human's time. A $150 agent-written board memo is cheap if it saves days of a CEO's time and produces a superior result.

Ramp's CPO argues companies shouldn't excessively worry about AI token costs. If an AI agent can deliver 10x the output of a human, it's logical and profitable to pay the agent (via tokens) more than the human's salary. This reframes ROI from a cost center to a massive productivity investment.

According to Mike Cannon-Brookes, advanced enterprises are not tracking AI success by counting tokens. Instead, they are asking harder questions about overall output, such as engineering productivity and quality. They understand that high token usage doesn't always correlate with high productivity, shifting focus from raw usage to tangible business outcomes.

Heavy use of AI agents and API calls is generating significant costs, with some agents costing $100,000 annually. This creates a new financial reality where companies must budget for 'tokens' per employee, potentially making the AI's cost more than the human's salary.

By analyzing time savings across tasks on its platform, Anthropic calculates a potential 1.8 percentage point annual lift to labor productivity. This bottom-up, data-driven estimate is more than double the typical economist's forecast of ~0.8%, which often relies on historical analogs.