Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

Turkish high schoolers with unrestricted AI math practice scored 48% higher with the tool but 17% below unaided peers on a closed-book exam, Eric So says. In Nigeria, students using AI in pairs with explanation prompts gained 1.5 to 2 years of schooling for $48 each. Design determined whether AI tutored or answered.

Related Insights

Controlled testing shows that using generative AI to explain concepts enhances students' subsequent unaided writing performance one week later. Conversely, students who rely on AI to automate drafting lose all short-term performance gains once the tool is removed, as bypassing cognitive effort halts learning.

The most transformative application of AI could be in education, by making one-on-one tutoring universally accessible. This method, known as Bloom's 2 sigma effect, is proven to be incredibly effective but has been historically impossible to scale due to human limitations. AI can finally deliver this for every student.

High homework scores previously predicted strong exam outcomes, but AI adoption has inverted this relationship. Students who use AI to drastically cut completion time suffer severe test score declines, meaning top homework marks now frequently indicate answer outsourcing rather than genuine subject mastery.

A study found students using AI had 18% higher homework scores but 20% lower exam results. This reverses the long-held correlation where strong homework performance predicted success on tests, suggesting that students are using AI for answers rather than understanding.

A field experiment cited by the hosts revealed that high school math students using general chatbots improved assisted practice but suffered a 17% decline in unassisted exam performance. Conversely, carefully structured AI tutors in a university physics setting delivered stronger immediate learning gains.

Historically, one-on-one tutoring—proven to boost student outcomes by two standard deviations (the "Bloom Two Sigma effect")—was reserved for the elite. AI now makes this highly effective, personalized educational model scalable and accessible to all.

While cheating is a concern, a more insidious danger is students using AI to bypass deep cognitive engagement. They can produce correct answers without retaining knowledge, creating a cumulative learning deficit that is difficult to detect and remedy.

A professor found students scored 96% on a take-home exam with AI access but only 48% on an in-person final. This drastic gap proves AI can entirely replace student effort, not just assist it. This renders remote assessments unreliable indicators of actual knowledge and creates a false impression of competence.

The traditional school year allocates hundreds of hours to each subject. Data from Alpha School shows that with a mastery-based AI tutor, students can master an entire K-8 grade-level curriculum in only 20-30 hours. This 10x improvement highlights the massive inefficiency of the teacher-led classroom model.

Unrestricted AI assistance leads to worse post-intervention exam scores compared to studying with no AI at all. However, prompt-engineered systems like GPT-Tutor, which withhold direct solutions in favor of structured explanations and hints, successfully protect student learning and preserve unaided test performance.