Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The dominant AI use case will shift from real-time, human-in-the-loop chatbots to long-running background agents. For these agents, which work for hours or days, an extra few seconds of latency is meaningless, unlocking massive cost-saving opportunities by prioritizing throughput over speed.

Related Insights

The majority of AI-driven software development will shift from human-prompted (synchronous) tasks to autonomous agents working 24/7 (asynchronous). This "dark factory" concept means agents will identify, scope, and solve problems without direct, real-time human command, fundamentally changing the development lifecycle.

Work will bifurcate into two modes: delegating tasks to asynchronous agents (e.g., in Slack) and performing core work inside AI-native environments like Codex. These platforms will become the primary operating system where you run other apps, rather than AI being just a feature within apps.

Optimizing a GPU for low-latency (fast, individual responses) inherently sacrifices its peak throughput (total work done over time). The market's focus on chatbots has over-indexed on latency, creating a major opportunity for companies that build systems optimized for high-throughput, background tasks.

Unlike web apps where users expect instant responses, messaging apps have a built-in expectation of delay. This makes them the ideal interface for AI agents that need time to perform ambitious, complex tasks without frustrating the user.

A 2-second delay is acceptable for a single user prompt. However, in an agentic system where 20 agents communicate sequentially, that delay compounds to 40 seconds, rendering the application unusable. This shift necessitates infrastructure with sub-second response times, driving hardware deployment to urban centers.

Currently, 80% of AI usage is human-initiated, but a crossover is expected this year where automated, background agentic tasks will dominate token consumption. This shift will decouple AI usage from human attention and create truly unbounded demand for inference, fundamentally changing the market.

The next frontier in AI is not just developing individual agents, but orchestrating teams of them. Users will move from dialoguing with a single chatbot to managing multiple agents working in parallel on complex, long-running workflows. This becomes a new core skill for knowledge workers.

The next leap in productivity isn't just using an AI assistant for synchronous tasks. It's becoming an "IC manager of agents," overseeing a team of 20-30 AI agents working concurrently on long-running, asynchronous tasks, creating a massive leverage factor.

Kevin Scott predicts that agent interaction will soon shift from a synchronous model (user waits for an immediate response) to an asynchronous one. Users will delegate complex tasks that agents work on over extended periods, iterating and integrating information before reporting back with results.

The most profound near-term shift from AI won't be a single killer app, but rather constant, low-level cognitive support running in the background. Having an AI provide a 'second opinion for everything,' from reviewing contracts to planning social events, will allow people to move faster and with more confidence.