/
© 2026 RiffOn. All rights reserved.

Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

  1. The Product Experience: a Mind the Product podcast
  2. How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)
How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI)

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast · Aug 12, 2026

OpenAI's Blaine Billingsley on designing with LLMs, rapid prototyping, and how small, agile teams are redefining product development at speed.

At OpenAI, a Designer's Job Is Defining AI Output Quality, Not Pushing Pixels

The role of a designer at an AI-native company shifts from traditional interface design to defining success metrics. This involves evaluating the quality and format of AI-generated content and deciding on the heuristics for what constitutes a good output, making it a categorically different job.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

Use LLMs to Generate 80 Bad Ideas to Find One Good One

The creative superpower of LLMs isn't perfection, but massive volume. By embracing the "thousand pots" approach, teams can generate a vast quantity of ideas in minutes. This deluge of content, while mostly unusable, will contain a few inspiring nuggets for iteration that human-only processes might miss.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

Rapid AI Prototyping Eliminates the "Fear of Time" and the Need for Roadmaps

Because AI tools allow teams to build and iterate so quickly, the "fear of time" diminishes. This reduces the need for traditional planning artifacts like roadmaps and presentation decks, allowing teams to focus on building and discussing tangible work in the present moment.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

In AI-First Companies, Job Titles Blur into a Single "Maker" Role

In fast-paced AI development, traditional specializations like "designer" and "engineer" merge. Individuals contribute based on their strengths rather than a fixed job description, with everyone empowered to ship code and design mockups, creating a more equalized playing field where specialization feels vague.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

Model Evaluations Function as a New Form of Synthetic User Research

Evaluating AI model outputs ("evals") is a new, crucial part of the product development cycle. It acts as a form of synthetic user research, but its primary challenge is anticipating the wide variety of user prompts and avoiding the pitfall of optimizing for a narrow, biased set of inputs.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

For Billion-User Products like Gmail, Design for Failure at the Extremes

When designing for a massive, diverse user base, traditional persona-based HCI methods fail. The focus must shift to creating simple, general mechanics and then rigorously testing how they succeed and, more importantly, how they fail at their absolute extremes. Understand where the app "declares bankruptcy."

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

AI Speeds Up the First 80% of Development, But the Final 20% Is Still Grueling

While AI tools can get you from zero to a functioning prototype in a weekend, the "second 80%" of the work—navigating dependencies, rewriting for different environments, and dealing with production complexities—is still a grueling, multi-week process. The path to shipping remains as difficult as ever.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

OpenAI Aligns Teams Through a "Rallying Cry," Not Top-Down Roadmaps

In a rapidly changing environment, formal roadmaps create friction. OpenAI's alternative is a clear company-wide "rallying cry"—the one or two most important goals. This empowers teams to self-organize and swarm priorities collaboratively, reducing the internal strife caused by competing priorities.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago

AI Transforms Design Sprints by Replacing Voting with Instant Prototyping

In traditional design sprints, teams vote on static ideas due to the high cost of prototyping. With LLMs, you can skip voting. Instead, generate multiple rich, interactive prototypes for the top ideas simultaneously, allowing decisions based on tangible user experiences, not abstract concepts on sticky notes.

How OpenAI makes product decisions and builds at speed —  Blaine Billingsley (Member of Technical Design Staff, OpenAI) thumbnail

How OpenAI makes product decisions and builds at speed — Blaine Billingsley (Member of Technical Design Staff, OpenAI)

The Product Experience: a Mind the Product podcast·5 hours ago