Performance and learning are different outcomes
What the research found
In a randomized field experiment involving nearly 1,000 high school mathematics students, Bastani and colleagues (2025) found that access to a general-purpose GPT-4 interface improved performance during supported practice. However, when students subsequently worked without the tool, that group scored 17% lower than students who had practiced without AI.
An AI tutor designed with learning safeguards largely mitigated this negative effect, although it did not produce a positive effect on subsequent unassisted performance. These findings come from a specific mathematics setting and should not be generalized to every use of AI.
How we apply it
This distinction informs our principle:
Completion ≠ Development.
We help educators examine both what students accomplish with support and what they can understand, explain, and do independently. Our AI-use decisions begin with the learning purpose and the thinking students need to practice.
Read the study
Bastani et al. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences.
