Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The underlying infrastructure for AI agents ('harnesses') becomes obsolete roughly every six months due to rapid advances in AI models. At Notion, this means completely rewriting the harness multiple times a year, demanding a culture comfortable with constantly rebuilding core systems and discarding previous assumptions.

Related Insights

Overly structured, workflow-based systems that work with today's models will become bottlenecks tomorrow. Engineers must be prepared to shed abstractions and rebuild simpler, more general systems to capture the gains from exponentially improving models.

Classic software engineering warns against full rewrites due to risk and time ("second-system syndrome"). However, AI's ability to rebuild an entire product in days, not years, makes rewriting a powerful and low-cost tool for correcting over-complicated early versions or flawed core assumptions.

The "bitter lesson" of AI applies to product development: complex scaffolding built around model limitations (like early vector stores or agent frameworks) will inevitably become obsolete as the models themselves get smarter and absorb those functions. Don't over-engineer solutions that a future model will solve natively.

Contrary to the classic engineering rule to "never rewrite," Block's CTO believes AI will make this the new standard. He is pushing his teams to imagine a world where for every release, they delete the entire app (`rm -rf`) and rebuild it from scratch, with AI respecting all incremental improvements from the previous version.

AI is evolving so rapidly that building for today's limitations is a mistake. Leaders should anticipate the state of the technology six months in the future and design products for that world. This prevents being quickly outdated by the pace of innovation.

In the fast-paced AI landscape, success is fleeting. The underlying models and capabilities are advancing so rapidly that market leaders must fundamentally reinvent their company and product every six to nine months. Stagnation for even a year means falling hopelessly behind, as demonstrated by Cursor's evolution from auto-complete to managing agentic swarms.

Unlike traditional, long-lasting infrastructure, AI skills have a short half-life due to rapid model updates and changing contexts. Treat them as iterative, ephemeral assets that must be re-evaluated on a monthly basis to remain effective.

While intricate software "scaffolding" can boost an AI agent's performance, progress is overwhelmingly driven by the core model. A new model generation typically achieves the same capabilities with simple prompts that previously required complex engineering.

To fully leverage rapidly improving AI models, companies cannot just plug in new APIs. Notion's co-founder reveals they completely rebuild their AI system architecture every six months, designing it around the specific capabilities of the latest models to avoid being stuck with suboptimal implementations.

To keep pace with AI model advancements, startups selling to enterprises must compress their product lifecycle. This means being willing to push major product revisions and deprecations every few months, rather than on a traditional multi-year schedule, or risk being disrupted themselves.

Notion Rewrites Its Core AI Agent Harness Every 6 Months, Rendering Old Assumptions Obsolete | RiffOn