Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Gusto's "Cofounder" team achieved a median PR review time of just nine minutes, facilitated by a constant "PermaZoom" room where reviews could be requested and conducted instantly. This proves that ultra-fast human feedback loops, not just AI code generation, are the true enabler of rapid development.

Related Insights

The traditional product feedback loop is being compressed by AI. Instead of waiting for human developers to test a beta, companies like Stripe now see AI agents deployed instantly. These agents provide immediate, detailed feedback through logs, allowing for an unprecedented pace of iteration and development.

OpenAI's team found that as code generation speed approaches real-time, the new constraint is the human capacity to verify correctness. The challenge shifts from creating code to reviewing and testing the massive output to ensure it's bug-free and meets requirements.

Traditional software development processes, like peer code reviews, were built for a cadence of 10-15 PRs per month. When AI agents enable a 10x increase in output, the human team becomes the bottleneck, forcing a shift towards AI-driven review and validation.

As AI accelerates content and code generation, the primary challenge is no longer creation but the overwhelming volume of work that needs review. Loredana Crisan notes that teams are becoming bottlenecked by review cycles, highlighting a need for new collaborative and automated review workflows.

With AI agents capable of generating code and designs at an unprecedented rate, the new chokepoint in workflows is human review. The primary challenge is no longer production but scaling the evaluation process to ensure AI-generated output aligns with quality standards and company values.

A surprising side effect of using AI at OpenAI is improved code review quality. Engineers now use AI to write pull request summaries, which are consistently more thorough and better at explaining the 'what' and 'why' of a change. This improved context helps human reviewers get up to speed faster.

AI has compressed development cycles from weeks to days, but it hasn't equally accelerated human coordination. The new bottleneck is getting stakeholders aligned on strategy, planning user communication, and managing the "fuzzy" aspects of a launch. While coding saw a 100x speed-up, these coordination problems remain.

AI's true productivity leverage is not just speed but enabling more attempts. A human might get one shot at a complex task, whereas an AI-assisted workflow allows for three or more "turns at the wheel." The critical human skill shifts from initial creation to rapid review and refinement of these iterations.

To compress feedback cycles, Coinbase built a tool that captures live audio feedback, uses an LLM to create a structured bug report in Linear, and then triggers an internal Slack bot to immediately begin authoring a pull request. This reduces the feedback-to-fix cycle from weeks to minutes.

AI agents can generate code far faster than humans can meaningfully review it. The primary challenge is no longer creation but comprehension. Developers spend most of their time trying to understand and validate AI output, a task for which current tools like standard PR interfaces are inadequate.

A 9-Minute Median PR Review Time is the Linchpin of AI-Powered Speed | RiffOn