lehmann-2024

Abstract

This study examines how LLM usage patterns affect learning outcomes through pre-registered laboratory experiments and a field study. The researchers found that the effect depends critically on how students interact with LLMs: substituting learning activities with LLM-generated solutions increases topic coverage but decreases understanding, while using LLMs for explanations maintains volume and deepens comprehension. LLMs also widen the gap between students with low and high prior knowledge.