Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Glean's founder reveals that even with AI generating almost all initial code, their product shipping velocity hasn't significantly increased. The bottleneck has shifted from writing code to the human review process. Manual oversight remains critical for maintaining quality and managing long-term complexity.

Related Insights

OpenAI's team found that as code generation speed approaches real-time, the new constraint is the human capacity to verify correctness. The challenge shifts from creating code to reviewing and testing the massive output to ensure it's bug-free and meets requirements.

As AI generates vast quantities of code, the primary engineering challenge shifts from production to quality assurance. The new bottleneck is the limited human attention available to review, understand, and manage the quality of the codebase, leading to increased fragility and "slop" in production.

As AI coding agents generate vast amounts of code, the most tedious part of a developer's job shifts from writing code to reviewing it. This creates a new product opportunity: building tools that help developers validate and build confidence in AI-written code, making the review process less of a chore.

With AI making code generation cheap, the limiting factors for development velocity are now defining what to build (product) and ensuring its quality (review). Engineers will increasingly focus on high-level systems architecture rather than typing code.

Traditional software development processes, like peer code reviews, were built for a cadence of 10-15 PRs per month. When AI agents enable a 10x increase in output, the human team becomes the bottleneck, forcing a shift towards AI-driven review and validation.

As AI accelerates content and code generation, the primary challenge is no longer creation but the overwhelming volume of work that needs review. Loredana Crisan notes that teams are becoming bottlenecked by review cycles, highlighting a need for new collaborative and automated review workflows.

With AI agents capable of generating code and designs at an unprecedented rate, the new chokepoint in workflows is human review. The primary challenge is no longer production but scaling the evaluation process to ensure AI-generated output aligns with quality standards and company values.

With AI generating 1,300 pull requests weekly at Stripe, the critical path is shifting. When coding becomes a commodity, the bottleneck moves to human review and validation. Engineering teams must refocus from pure creation to oversight and quality assurance at scale.

Simply deploying AI to write code faster doesn't increase end-to-end velocity. It creates a new bottleneck where human engineers are overwhelmed with reviewing a flood of AI-generated code. To truly benefit, companies must also automate verification and validation processes.

With AI agents autonomously generating pull requests, the primary constraint in software development is no longer writing code but the human capacity to review it. Companies like Block are seeing PRs per engineer increase massively, creating a new challenge for engineering managers to solve.