Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

A visually rich, dynamic website designed for humans can be difficult for AI crawlers to parse. The optimal solution is to serve two versions of a page: the engaging human-facing version, and a simplified, structured HTML version specifically for AI agents, ensuring they can easily consume content without degrading the user experience.

Related Insights

Traditional website optimization focused on human experience and SEO for search bots. A third pillar is now essential: optimizing for AI advisory tools and recommendation engines through structured data like product feeds and APIs.

The rise of AI browsers introduces 'agents' that automate tasks like research and form submissions. To capture leads from these agents, websites must feature simple, easily parsable forms and navigation, creating a new dimension of user experience focused on machine readability.

Websites now have a dual purpose. A significant portion of your content must be created specifically for AI agents—niche, granular, and structured for LLM consumption to improve AEO. The human-facing part must then evolve to offer deeper, more interactive experiences, as visitors will arrive with their basic research already completed by AI.

The audience for marketing content is expanding to include AI agents. Websites, for example, will need to be optimized not just for human users but also for AI crawlers that surface information in answer engines. This requires a fundamental shift in how marketers think about content structure and metadata.

A traditional, human-focused homepage with videos and marketing copy is invisible to AI agents. To engage this new class of user, companies must create dedicated, agent-readable entry points (e.g., a '/agents' page) that provide structured docs, schemas, policies, and API endpoints. Without this, you don't exist in the agent economy.

Modern landing pages serve a dual purpose. Beyond converting human visitors, they must provide clear, structured information—product details, reviews, comparisons—to feed the AI layer, including shopping agents and LLMs. This machine readability is becoming as critical as user experience for brand discovery and sales.

Beyond human-centric design, websites and content must now be structured for easy ingestion by AI models. This "agent-readable" format is crucial for ensuring a brand's information is accurately represented and prioritized by LLMs when they evaluate options for consumers.

Notch CEO Anda Gansca observes that brands' attempts at "Agent Engine Optimization" (AEO)—stuffing websites with keyword-heavy content for LLMs—are backfiring. This tactic creates a terrible, unnavigable experience for human visitors, leading to "crazy high immediate bounce rates" and necessitating a new, dual-audience approach.

The rise of AI agents means website traffic will increasingly be non-human. B2B marketers must rethink their playbooks to optimize for how AI models interpret and surface their content, a practice emerging as "AI Engine Optimization" (AEO), as agents become the primary researchers.

Just as websites were optimized for Google's crawlers in the late 90s, brands must now structure their digital presence to be readable by AI shopping agents. Failure to do so will result in being completely invisible to automated purchasing systems, as agent traffic is already overtaking human traffic.