Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Ben Sabrin built a complex seven-tab pricing model, margin calculator, and partner sheet in five hours by treating Claude as a thought partner rather than an autonomous generator. John Kaplan points out that leaders must understand the domain to catch model errors and establish strict guidelines against blindly circulating unread generated text.

Related Insights

Generative AI can be used as a conversational expert to quickly gain deep domain knowledge in new industries. By engaging in long dialogues about market trends, regulations, and business models (e.g., value-based medicine), a leader can compress months of research into a single afternoon.

Don't treat AI as an omniscient expert. Instead, view it as an intern: provide clear, detailed instructions, show examples of the desired output, and always review the results critically. You wouldn't let an intern's work go straight to the board, and you shouldn't with AI either.

Generative AI is not a deterministic tool that provides a single correct answer. It's an "artistic" system that invents and generates, often "hallucinating." This requires a leadership mindset shift to treat AI as a creative partner that needs human judgment and verification, rather than an infallible computer.

A KPMG analysis of 1.4 million AI interactions reveals that the most effective users don't just write sophisticated prompts. They treat AI as a collaborative partner, guiding its thinking, framing problems, and iterating to achieve better outcomes. This reframes the key skill from engineering to strategic reasoning.

The most effective use of AI is to amplify what you are already good at. An expert can guide the model, spot its errors, and leverage its output. Using AI in an area where you lack expertise is dangerous, as you can be easily misled by plausible but incorrect information.

A powerful, under-explored use of LLMs is as a tool to enhance human cognition. Rather than simply generating answers, one can interact with them to challenge, validate, and improve one's own mental models of a system or problem, creating a valuable learning loop.

Conceptualize Large Language Models as capable interns. They excel at tasks that can be explained in 10-20 seconds but lack the context and planning ability for complex projects. The key constraint is whether you can clearly articulate the request to yourself and then to the machine.

Don't blindly trust AI. The correct mental model is to view it as a super-smart intern fresh out of school. It has vast knowledge but no real-world experience, so its work requires constant verification, code reviews, and a human-in-the-loop process to catch errors.

AI models lack novel context and frequently produce errors. The success of an AI-first product hinges on leveraging domain experts to build the model's "muscle," provide essential context, and constantly validate its output to ensure accuracy and value.

GSB professors warn that professionals who merely use AI as a black box—passing queries and returning outputs—risk minimizing their own role. To remain valuable, leaders must understand the underlying models and assumptions to properly evaluate AI-generated solutions and maintain control of the decision-making process.