AI models are surprisingly strong at certain tasks but bafflingly weak at others. This 'jagged frontier' of capability means that experience with AI can be inconsistent. The only way to navigate it is through direct experimentation within one's own domain of expertise.

Salesforce's AI Chief warns of "jagged intelligence," where LLMs can perform brilliant, complex tasks but fail at simple common-sense ones. This inconsistency is a significant business risk, as a failure in a basic but crucial task (e.g., loan calculation) can have severe consequences.

AI's capabilities are inconsistent; it excels at some tasks and fails surprisingly at others. This is the 'jagged frontier.' You can only discover where AI is useful and where it's useless by applying it directly to your own work, as you are the only one who can accurately judge its performance in your domain.

There's a significant gap between AI performance in simulated benchmarks and in the real world. Despite scoring highly on evaluations, AIs in real deployments make "silly mistakes that no human would ever dream of doing," suggesting that current benchmarks don't capture the messiness and unpredictability of reality.

Standardized benchmarks for AI models are largely irrelevant for business applications. Companies need to create their own evaluation systems tailored to their specific industry, workflows, and use cases to accurately assess which new model provides a tangible benefit and ROI.

Progress towards AGI is not a smooth climb. Models exhibit "spikiness"—they can perform at a world-class level on one narrow domain but degrade to a "bad high school student" with slight perturbations. This non-intuitive generalization makes their capabilities uneven and unpredictable.

Alex Karp argues that an AI's high score on a single benchmark is irrelevant for enterprise adoption. Real institutions require passing thousands of consecutive, differentiated tests. An AI model that is brilliant at one task but fails at the 50th in a complex sequence is effectively useless.

The rapid improvement of AI models is maxing out industry-standard benchmarks for tasks like software engineering. To truly understand AI's impact and capability, companies must develop their own evaluation systems tailored to their specific workflows, rather than waiting for external studies.

Frontier AI models exhibit 'jagged' capabilities, excelling at highly complex tasks like theoretical physics while failing at basic ones like counting objects. This inconsistent, non-human-like performance profile is a primary reason for polarized public and expert opinions on AI's actual utility.