← What we believe Evidence library

Home · Sources · AI-010

ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention

Authors: Barcaui, A. · Year: 2025 · Tier: RCT · DOI/URL: https://doi.org/10.1016/j.ssaho.2025.102287

Adults / lifelong learning AI and learning

Links to claims

Supports (1)

ClaimBasis
C2HE RCT: unrestricted ChatGPT study aid → lower Day-45 surprise retention vs traditional (d = 0.68); learning measured without the tool.

Review state: first-pass draft, pending human review.

Source note (Swedish, verbatim from the Kunskapsbank)

Syntes: Barcaui (2025) — ChatGPT as a cognitive crutch

Källa: Barcaui, A. (2025). ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention. Social Sciences & Humanities Open, 12, 102287. https://doi.org/10.1016/j.ssaho.2025.102287

Metadata

Finding

  1. Traditional learners scored higher on the Day-45 surprise retention test than ChatGPT-assisted learners (M 6.85 vs 5.75 on a 10-point scale ≈ 68.5 % vs 57.5 %; t(83) = −3.19, p = .002, d = 0.68).
  2. AI-assisted group spent less time on task (3.2 h vs 5.8 h); the AI disadvantage remained after controlling for study time (ANCOVA F(1,82) = 7.89, p = .006).
  3. Prior AI familiarity did not significantly predict retention (r = 0.18, ns).

Mechanism

Cognitive offloading / removal of desirable difficulties: unrestricted ChatGPT reduces effortful encoding; retention measured without the tool is lower.

Limits

Single university, business programme, convenience sample; ~29 % attrition (balanced across arms); AI use in the control arm not directly monitored; presentation-preparation task may differ from exam-only study.

This claim dies if …

A replicated HE/K–12 RCT with delayed closed-book measurement finds typical unrestricted ChatGPT/answer-giving GenAI use does not lower retention vs control.

Swedish implication

Measure learning without the tool after practice with GenAI; unrestricted answer-giving use is a learning risk, not only a homework-quality boost.

Links

Metadata as recorded

ID
AI-010
Tier
RCT
Closed-book follow-up
ja (surprise retention test 45 days later, no AI)
Titel
ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention
Författare
Barcaui, A.
År
2025 (available online 29 Nov 2025)
Källa/DOI
https://doi.org/10.1016/j.ssaho.2025.102287
URL
https://www.sciencedirect.com/science/article/pii/S2590291125010186
URL (OA PDF mirror)
https://www.csueastbay.edu/writing/files/docs/chat-gpt-as-cognitive-crutch.pdf
Typ
RCT (n=120 undergraduates assigned; 85 completed Day-45 test)
Åldersgrupp
vuxen / HE (business undergraduates, Brazil)
Teman
ai-och-larande; uppmarksamhet-och-minne (cognitive offloading / desirable difficulties)
Sparade fil
Barcaui-2025-ChatGPT-cognitive-crutch.pdf
Hämtad
2026-09-27
Paywall
OA CC BY-NC-ND (Elsevier Social Sciences & Humanities Open)

Original files held in the project (not published): Barcaui-2025-ChatGPT-cognitive-crutch.pdf