Dell's CTO identifies a new architectural component: the "knowledge layer" (vector DBs, knowledge graphs). Unlike traditional data architectures, this layer should be placed near the dynamic AI compute (e.g., on an edge device) rather than the static primary data, as it's perpetually hot and used in real-time.

Related Insights

Don't view AI as just a feature set. Instead, treat "intelligence" as a fundamental new building block for software, on par with established primitives like databases or APIs. When conceptualizing any new product, assume this intelligence layer is a non-negotiable part of the technology stack to solve user problems effectively.

Companies struggle with AI not because of the models, but because their data is siloed. Adopting an 'integration-first' mindset is crucial for creating the unified data foundation AI requires.

Don't just sprinkle AI features onto your existing product ('AI at the edge'). Transformative companies rethink workflows and shrink their old codebase, making the LLM a core part of the solution. This is about re-architecting the solution from the ground up, not just enhancing it.

To build a multi-billion dollar database company, you need two things: a new, widespread workload (like AI needing data) and a fundamentally new storage architecture that incumbents can't easily adopt. This framework helps identify truly disruptive infrastructure opportunities.

The current focus on building massive, centralized AI training clusters represents the 'mainframe' era of AI. The next three years will see a shift toward a distributed model, similar to computing's move from mainframes to PCs. This involves pushing smaller, efficient inference models out to a wide array of devices.

To enable AI tools like Cursor to write accurate SQL queries with minimal prompting, data teams must build a "semantic layer." This file, often a structured JSON, acts as a translation layer defining business logic, tables, and metrics, dramatically improving the AI's zero-shot query generation ability.

Contrary to the prevailing 'scaling laws' narrative, leaders at Z.AI believe that simply adding more data and compute to current Transformer architectures yields diminishing returns. They operate under the conviction that a fundamental performance 'wall' exists, necessitating research into new architectures for the next leap in capability.

The primary reason multi-million dollar AI initiatives stall or fail is not the sophistication of the models, but the underlying data layer. Traditional data infrastructure creates delays in moving and duplicating information, preventing the real-time, comprehensive data access required for AI to deliver business value. The focus on algorithms misses this foundational roadblock.

AI tools like LLMs thrive on large, structured datasets. In manufacturing, critical information is often unstructured 'tribal knowledge' in workers' heads. Dirac’s strategy is to first build a software layer that captures and organizes this human expertise, creating the necessary context for AI to then analyze and add value.

The ultimate value of AI will be its ability to act as a long-term corporate memory. By feeding it historical data—ICPs, past experiments, key decisions, and customer feedback—companies can create a queryable "brain" that dramatically accelerates onboarding and institutional knowledge transfer.

Modern AI Requires a "Knowledge Layer" That Sits Closer to Compute Than Data | RiffOn