← What we believe Evidence library

Home · Sources · AI-005

Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies

Authors: Deng, R.; Jiang, M.; Yu, X.; Lu, Y.; Liu, S. · Year: 2025 (online Dec 2024) · Tier: meta · DOI/URL: https://doi.org/10.1016/j.compedu.2024.105224

Upper secondary Across ages Adults / lifelong learning AI and learning

Links to claims

Supports (1)

ClaimBasis
K16 (candidate)Note carries the bank kill sentence behind K16 (group K16); no change in review

Challenges (1)

ClaimBasis
C2Positive pooled effect of ChatGPT; the bank notes that without closed-book outcomes this is performance, not learning. Open test for C2.

Review state: first-pass draft, pending human review.

Source note (Swedish, verbatim from the Kunskapsbank)

Syntes: Deng m.fl. (2025) — Does ChatGPT enhance student learning?

ID: AI-005
Tier: meta
Closed-book follow-up: nej / blandat — författarna flaggar själva mätbias
HE vs K–12: mest HE; ~14 % K–12
Novelty decay: ja — tidiga studier riskerar novelty inflation
Utfallslabel: prestation, inte lärande

Metadata

Finding

SR+meta positiv snitteffekt; Deng et al. varnar för measurement bias. Utan closed-book: prestation, inte lärande.

Mechanism

Ospecificerad pool — inkluderar olikartade pedagogiska roller.

Limits

K–12-tunn; closed-book sällan; novelty.

This claim dies if …

Bias-korrigerad analys med endast delayed closed-book ger noll/negativ effekt.

Swedish implication

Measure med samma ribba som Bastani (closed-book); annars label prestation.

Links

Metadata as recorded

ID
AI-005
Tier
meta
Closed-book follow-up
nej / blandat (författarna flaggar mätbias)
HE vs K–12
mest HE; ~14 % K–12
Titel
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Författare
Deng, R.; Jiang, M.; Yu, X.; Lu, Y.; Liu, S.
År
2025 (online Dec 2024)
Källa/DOI
https://doi.org/10.1016/j.compedu.2024.105224
URL
https://www.sciencedirect.com/science/article/pii/S0360131524002380
Typ
systematisk review + meta-analys (69 artiklar; 62 i meta)
Åldersgrupp
övergripande (mest university; ~14 % K–12)
Teman
ai-och-larande
Sparade fil
ABSTRACT.md (OA CC BY enligt Elsevier; full PDF ej speglad här p.g.a. blockerad spegellänk — nyckeltal från OA-fulltext via WebFetch)
Hämtad
2026-09-07
Paywall
Nej (CC BY) — fulltext gratis via ScienceDirect/Elsevier

Original files held in the project (not published): ABSTRACT.md