Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

The rapid pace of AI paradigm shifts—from simple token-in/token-out models to complex agentic systems—forces a complete infrastructure rewrite every 12 to 18 months. Google's lesson for large organizations is to invest in standardized platforms to avoid having every team reinvent the wheel and fall behind.

Related Insights

History shows that major technological shifts like the internet and AI require a fundamental re-architecting of everything from silicon and networking up to software. The industry repeatedly forgets this lesson, mistakenly declaring parts of the stack, like hardware, as commoditized right before the next wave hits.

Classic software engineering warns against full rewrites due to risk and time ("second-system syndrome"). However, AI's ability to rebuild an entire product in days, not years, makes rewriting a powerful and low-cost tool for correcting over-complicated early versions or flawed core assumptions.

Google's strategy involves the core AI model progressively absorbing the surrounding tooling and infrastructure (the "scaffolding"). This creates a standardized, extensible "harness" that accelerates development and ensures a consistent, high-quality agentic experience across Google's vast and diverse product landscape, from Search to consumer apps.

In the fast-paced AI landscape, success is fleeting. The underlying models and capabilities are advancing so rapidly that market leaders must fundamentally reinvent their company and product every six to nine months. Stagnation for even a year means falling hopelessly behind, as demonstrated by Cursor's evolution from auto-complete to managing agentic swarms.

The AI landscape is uniquely challenging due to the rapid depreciation of both models (new ones top leaderboards weekly) and hardware (Nvidia launched three new SKUs in one year). This creates a constant, complex management burden, justifying the need for platforms that abstract away these choices.

To keep pace with rapid AI advancements, the company intentionally operates on a two-year horizon for its technology stack. This forces them to be dynamic and adapt to new research, rather than getting locked into outdated architectures, having completed four such evolutions so far.

Unlike traditional internet protocols that matured slowly, AI technologies are advancing at an exponential rate. An AI standards body must operate at a much higher velocity. The Agentic AI Foundation is structured to facilitate this rapid, "dog years" pace of development, which is essential to remain relevant.

Building on AI requires creating custom infrastructure to fill performance gaps. As underlying models improve, founders must be prepared to delete this now-redundant code and upgrade their product vision to tackle the next set of challenges at the new frontier. This cycle of building and deleting is key to staying innovative.

The underlying infrastructure for AI agents ('harnesses') becomes obsolete roughly every six months due to rapid advances in AI models. At Notion, this means completely rewriting the harness multiple times a year, demanding a culture comfortable with constantly rebuilding core systems and discarding previous assumptions.

To fully leverage rapidly improving AI models, companies cannot just plug in new APIs. Notion's co-founder reveals they completely rebuild their AI system architecture every six months, designing it around the specific capabilities of the latest models to avoid being stuck with suboptimal implementations.