We scan new podcasts and send you the top 5 insights daily.
Unlike turn-based models that idle until prompted, continuous AI assistants run in the background evaluating calendars, messages, and emails. Delani Kahawala explains that assistants must handle multi-agent fan-outs while concurrently queuing conversational interruptions when an urgent real-world event supersedes an active voice dialogue.
Unlike standard chatbots where you wait for a response before proceeding, Cowork allows users to assign long-running tasks and queue new requests while the AI is working. This shifts the interaction from a turn-by-turn conversation to a delegated task model.
The dominant AI use case will shift from real-time, human-in-the-loop chatbots to long-running background agents. For these agents, which work for hours or days, an extra few seconds of latency is meaningless, unlocking massive cost-saving opportunities by prioritizing throughput over speed.
The speed of voice allows users to issue multiple complex commands in seconds. This requires a sophisticated backend that can fan out tasks for parallel processing while meticulously queuing the conversational responses to maintain a coherent, logical dialogue with the user, a non-trivial engineering feat.
Unlike turn-based chatbots, an effective AI assistant must be a "long-running agent" that continuously processes background information. Its architecture must support proactively interrupting an ongoing user conversation to deliver timely, critical updates, a significant departure from standard request-response models.
The next wave of AI assistants focuses on "interaction" or "bi-directional" models that can process information and respond in real-time, allowing users to interrupt them naturally. Startups like Thinking Machines Lab are competing directly with giants like OpenAI to create a more fluid, human-like conversational experience, moving beyond today's turn-based models.
By using a messaging UI, AI assistants like OpenClaw manage user expectations. Users are accustomed to delayed text replies, giving the AI permission to take its time on complex tasks without the interaction feeling slow or broken, unlike a synchronous web app.
To make an AI assistant feel more conversational, architect it to delegate long-running tasks to sub-agents. This keeps the primary run loop free for user interaction, creating the experience of an always-available partner rather than a tool that periodically becomes unresponsive.
While chatbots are a useful interface for on-demand tasks, the bulk of enterprise AI will be asynchronous agents working in the background. These agents will automate processes like contract review or security triage, surfacing results in dashboards, task lists, and queues for human review, rather than waiting for a direct user prompt.
Long-horizon agents, which can run for hours or days, require a dual-mode UI. Users need an asynchronous way to manage multiple running agents (like a Jira board or inbox). However, they also need to seamlessly switch to a synchronous chat interface to provide real-time feedback or corrections when an agent pauses or finishes.
A new AI architecture from Thinking Machines Lab processes user interaction in continuous 200ms 'micro-turns' rather than waiting for a user to finish speaking. This allows for simultaneous listening and responding, moving AI from a static, email-like exchange to a dynamic, real-time partnership.