We scan new podcasts and send you the top 5 insights daily.
Chris Fregley argues that manually reviewing AI-generated code is slow and ineffective. He has replaced traditional code reviews and unit tests with a focus on robust, continuous evaluation frameworks ("evals") and correctness checks that run in the background, allowing for faster and safer code deployment.
The focus of "code review" is shifting from line-by-line checks to validating an AI's initial architectural plan. After plan approval, AI agents like OpenAI's Codex can effectively review their own generated code, a capability they have been explicitly trained for, making human code review obsolete.
As AI coding agents generate vast amounts of code, the most tedious part of a developer's job shifts from writing code to reviewing it. This creates a new product opportunity: building tools that help developers validate and build confidence in AI-written code, making the review process less of a chore.
As AI generates more code than humans can review, the validation bottleneck emerges. The solution is providing agents with dedicated, sandboxed environments to run tests and verify functionality before a human sees the code, shifting review from process to outcome.
Cisco is developing its AI defense product entirely with AI-written code, with human engineers acting as "spec developers." This fundamentally changes the software development lifecycle, making code review—not code creation—the primary bottleneck and indicating a future where engineering productivity is redefined.
Simply deploying AI to write code faster doesn't increase end-to-end velocity. It creates a new bottleneck where human engineers are overwhelmed with reviewing a flood of AI-generated code. To truly benefit, companies must also automate verification and validation processes.
To maintain high velocity with AI coding assistants, Chris Fregly has stopped line-by-line code reviews and traditional unit testing. He now focuses on high-level evaluations and 'correctness harnesses' that continuously run in the background, shifting quality control from process (review) to outcome (performance).
AI agents can generate and merge code at a rate that far outstrips human review. While this offers unprecedented velocity, it creates a critical challenge: ensuring quality, security, and correctness. Developing trust and automated validation for this new paradigm is the industry's next major hurdle.
A new paradigm for AI-driven development is emerging where developers shift from meticulously reviewing every line of generated code to trusting robust systems they've built. By focusing on automated testing and review loops, they manage outcomes rather than micromanaging implementation.
It's infeasible for humans to manually review thousands of lines of AI-generated code. The abstraction of review is moving up the stack. Instead of checking syntax, developers will validate high-level plans, two-sentence summaries, and behavioral outcomes in a testing environment.
As AI generates more code, the core engineering task evolves from writing to reviewing. Developers will spend significantly more time evaluating AI-generated code for correctness, style, and reliability, fundamentally changing daily workflows and skill requirements.