We scan new podcasts and send you the top 5 insights daily.
Eric So calls the 'dream team fallacy' the assumption that pairing a capable human with AI automatically improves decisions. In his X-ray example, a doctor may mistake AI agreement for independent confirmation or anchor on AI's answer when they disagree. He recommends forming your own judgment before seeing the AI recommendation.
Don't treat AI as an omniscient expert. Instead, view it as an intern: provide clear, detailed instructions, show examples of the desired output, and always review the results critically. You wouldn't let an intern's work go straight to the board, and you shouldn't with AI either.
Contrary to the belief that humans should always be 'in the loop,' strategic disengagement is key. By handing off well-defined 'middle' tasks entirely to AI, humans can conserve cognitive energy for high-leverage activities like initial problem-framing and final quality assurance, where their input is most valuable.
A key challenge in AI adoption is not technological limitation but human over-reliance. 'Automation bias' occurs when people accept AI outputs without critical evaluation. This failure to scrutinize AI suggestions can lead to significant errors that a human check would have caught, making user training and verification processes essential.
Counterintuitively, teams that outperform with AI feel worse because they treat it as a true conversation partner, which is hard work. Underperforming teams treat AI like a magic oracle, which feels easy and satisfying but yields generic results.
Despite hype in areas like self-driving cars and medical diagnosis, AI has not replaced expert human judgment. Its most successful application is as a powerful assistant that augments human experts, who still make the final, critical decisions. This is a key distinction for scoping AI products.
To effectively leverage AI, treat it as a new team member. Take its suggestions seriously and give it the best opportunity to contribute. However, just like with a human colleague, you must apply a critical filter, question its output, and ultimately remain accountable for the final result.
Don't blindly trust AI. The correct mental model is to view it as a super-smart intern fresh out of school. It has vast knowledge but no real-world experience, so its work requires constant verification, code reviews, and a human-in-the-loop process to catch errors.
To prevent "cognitive offloading" where employees blindly trust AI, design systems with deliberate friction. This forces a pause, encouraging users to apply their own judgment and take full accountability for the final output. It is crucial for high-stakes decisions where AI can make mistakes.
People often blindly trust AI output, leading to a flood of low-quality work ("AI slop"). To combat this, treat AI not as a genius, but as a lazy intern. This mindset forces you to provide context, coach it, iterate on its work, and take full accountability for the final product.
A significant risk in using AI for strategy is its inherent sycophancy. It tends to agree with your ideas and tell you what you want to hear, rather than providing the critical pushback a human colleague would. This lack of challenge can reinforce bad ideas and lead to poor decision-making.