The pace of AI model improvement is faster than the ability to ship specific tools. By creating lower-level, generalizable tools, developers build a system that automatically becomes more powerful and adaptable as the underlying AI gets smarter, without requiring re-engineering.
Related Insights
The power of tools like Claude Code comes from giving the AI access to fundamental command-line tools (e.g., `bash`, `grep`). This allows the AI to compose novel solutions and lets product teams define new features using simple English prompts rather than hard-coded logic.
Overly structured, workflow-based systems that work with today's models will become bottlenecks tomorrow. Engineers must be prepared to shed abstractions and rebuild simpler, more general systems to capture the gains from exponentially improving models.
A major trend in AI development is the shift away from optimizing for individual model releases. Instead, developers can integrate higher-level, pre-packaged agents like Codex. This allows teams to build on a stable agentic layer without needing to constantly adapt to underlying model changes, API updates, and sandboxing requirements.
Simply offering the latest model is no longer a competitive advantage. True value is created in the system built around the model—the system prompts, tools, and overall scaffolding. This 'harness' is what optimizes a model's performance for specific tasks and delivers a superior user experience.
Building an AI-native product requires betting on the trajectory of model improvement, much like developers once bet on Moore's Law. Instead of designing for today's LLM constraints, assume rapid progress and build for the capabilities that will exist tomorrow. This prevents creating an application that is quickly outdated.
In the fast-paced world of AI, focusing only on the limitations of current models is a failing strategy. GitHub's CPO advises product teams to design for the future capabilities they anticipate. This ensures that when a more powerful model drops, the product experience can be rapidly upgraded to its full potential.
When developing AI-powered tools, don't be constrained by current model limitations. Given the exponential improvement curve, design your product for the capabilities you anticipate models will have in six months. This ensures your product is perfectly timed to shine when the underlying tech catches up.
Companies like OpenAI and Anthropic are not just building better models; their strategic goal is an "automated AI researcher." The ability for an AI to accelerate its own development is viewed as the key to getting so far ahead that no competitor can catch up.
Using a composable, 'plug and play' architecture allows teams to build specialized AI agents faster and with less overhead than integrating a monolithic third-party tool. This approach enables the creation of lightweight, tailored solutions for niche use cases without the complexity of external API integrations, containing the entire workflow within one platform.
The perceived limits of today's AI are not inherent to the models themselves but to our failure to build the right "agentic scaffold" around them. There's a "model capability overhang" where much more potential can be unlocked with better prompting, context engineering, and tool integrations.
