← The story Evidence library

Home · C17

C17 weakened

Topic knowledge can outweigh general reading skill: weak readers who know a text's topic understand and recall it at least as well as strong readers who do not, and teaching topic knowledge has raised general reading test scores by about 0.1 to 0.25 standard deviations over ordinary teaching, though not in every trial.

Status
weakened
Last change
2026-11-04
Serves
Q1
Ages
grundskola-lag, grundskola-hog
Area
Reading and comprehension
Bounds
Topic or domain knowledge and reading comprehension; not decoding or phonics (C12), not reading on paper versus screens (C3). Evidence on file: Recht & Leslie 1988 (Journal of Educational Psychology; poor readers with high baseball knowledge recalled a baseball passage better than good readers with low knowledge). Limits on that study (corrected 2026-10-30; Reynolds, Hattan & Markham 2024, Reading Research Quarterly 60(1), e575, DOI 10.1002/rrq.575, full text): the four groups of 16 seventh and eighth graders were selected on measured reading ability and baseball knowledge, not randomly assigned; the poor-reader/high-knowledge group had 12 boys and 4 girls and the good-reader/low-knowledge group 3 boys and 13 girls; the 39-item knowledge test was 85% vocabulary and only 15 items (38%) touched the passage; the passage had almost no connecting words (Coh-Metrix connectivity at the 0th percentile). The review reports no result in which strong readers without knowledge beat weak readers with it, and its authors read the finding as one about domain rather than topic knowledge (open question 18); Kim et al. 2021 (Journal of Educational Psychology; cluster RCT, 38 first-grade classrooms, N = 674; knowledge-building units improved science vocabulary depth ES .30, listening comprehension ES .40 and a distal reading-comprehension measure; full text read 2026-10-30: a 10-lesson unit taught within a three-week window, the listening measure was four inferential questions on one passage with Cronbach's alpha .35, and the distal reading test (MAP) moved by ES .11). Context: Okkinga et al. 2018 (reading-strategy teaching in whole classrooms gave very small effects on standardised comprehension tests, d = 0.186). Kill-condition test survived 2026-10-16: Grissmer et al. 2023 (lottery-randomised Core Knowledge charter schools, grade 3–6 English-LA ITT 0.143 SD; working paper). Consistency bound (narrowed 2026-10-18): See, Gorard & Siddiqui 2017 (British Educational Research Journal 43(2), 372–393; DOI 10.1002/berj.3278; full EEF evaluation report of the same trial read, ERIC ED581108): Word and World Reading, an English adaptation of Core Knowledge for Years 3–4, nine schools randomised to start in 2013–14 and eight waitlisted; after one school year, gain on the long Progress in English test (spelling, grammar, reading comprehension, writing) was 24.7 vs 25.1, effect size −0.03 (−0.02 on age-standardised scores; +0.06 for pupils eligible for free school meals, not secure); 287 post-tests missing (206 treatment), one treatment school 43% of them; baseline imbalance; implementation uneven; the evaluators say the pilot did not seek to assess impact robustly. Kill withheld: a small pilot with high attrition and a general English outcome, against positive randomised and lottery results (Kim et al. 2021; Grissmer et al. 2023) and a meta-analysis (Hwang, Cabell & Joyner 2022, standardised comprehension ES 0.25, abstract only). The first prong (what readers already know affects understanding) was not tested. Consistency bound extended (narrowed 2026-10-22): Cabell, Kim, White, Gale, Edwards, Hwang, Petscher & Raines 2025 (Journal of Educational Psychology 117(2), 153–175; DOI 10.1037/edu0000916; published abstract and the authors' 2020 structured report of the same trials read; the published article's full text was not read, APA's PDF is behind a bot check): two school-randomised trials, the second a replication (23 + 24 = 47 schools in two large urban US districts, 82% and 44% free or reduced-price lunch, 1,194 kindergarteners), Core Knowledge Language Arts: Knowledge Strand read-alouds one hour daily for one semester vs waitlist control (the authors' 2020 report notes that control classrooms' read-alouds already included some science and social-studies topics; standardised receptive vocabulary, PPVT 0.001, and Woodcock-Johnson social studies, 0.01, were also null); large gains on the taught words (pooled ES 0.56) and topic knowledge, small gains on standardised expressive vocabulary (0.085) and science knowledge (0.116), but no discernible effect on standardised listening comprehension in either trial (pooled Test of Narrative Language 0.027, 95% CI −0.092 to 0.147; CELF-4 Sentence Structure −0.031, −0.121 to 0.059). Kill withheld: one semester, kindergarten, listening rather than reading comprehension, preliminary pooled numbers from the authors' report; Kim et al. 2021 and Grissmer et al. 2023 found gains, and a meta-analysis found a positive average on standardised comprehension (Hwang, Cabell & Joyner 2022, abstract only). Size range narrowed 2026-10-30 (weakened, Kim et al. 2021 full text): the claim's earlier upper end of about 0.4 SD came from that 10-day unit's four-item listening measure, not from a school year of teaching; on general reading or English tests the gains on file are 0.11 (Kim et al. 2021, MAP) and 0.14 to 0.24 (Grissmer et al. 2023), consistent with the meta-analytic standardised average of 0.25 (Hwang et al. 2022, abstract). Meta-analytic bound (weakened 2026-11-04, nightly attack): Kim & Cao 2025 (Psychological Bulletin 151(10), 1219–1244, DOI 10.1037/bul0000502; open access, full text read): causal data from 55 studies (N = 18,540): content knowledge instruction raised reading comprehension g = 0.44 (95% CI 0.18–0.70; I² = 97.75%), but norm-referenced tests only g = 0.21 vs researcher-made 0.51; knowledge building g = 0.19 (p > .05, not significant) vs knowledge activation 0.66 (difference p = .045); multi-group designs 0.18 (p < .01) vs single-class designs 0.67; listening comprehension 0.13 (95% CI −0.41 to 0.68; 5 studies, ns); correlational data (108 studies) r = .41 between knowledge and comprehension. Kill withheld: a non-significant moderator estimate under very high heterogeneity is not a finding that knowledge-building teaching does not improve comprehension, and the point estimate lies inside the claim's 0.1–0.25 range; the first and third kill prongs were not tested. Claim sentence shortened 2026-11-04 (Jonatan approved the short-claims rule): the trial details formerly in the sentence (See, Gorard & Siddiqui 2017, effect size −0.03 after a school year; Cabell et al. 2025, no effect on standardised listening comprehension after a semester; Kim & Cao 2025, knowledge-building programmes g = 0.19, not statistically significant) are kept above; meaning unchanged.
What would kill this
A well-controlled study finds that, once general reading skill is accounted for, topic knowledge does not improve understanding or memory of a text; or a well-powered randomised trial of at least a year of knowledge-building teaching finds no gain on a standardised reading test. Sharpened 2026-10-29 (bold expansion): the claim also dies if a well-controlled study finds that strong readers with little topic knowledge understand a text on that topic clearly better than weak readers with high topic knowledge. Sharpened 2026-11-04 (Jonatan's decision): the teaching prong, formerly "knowledge-building teaching does not improve comprehension", now names a well-powered randomised trial of at least a year and a standardised reading test. Promoted from K41 on 2026-10-16 in the broadening Jonatan approved 2026-10-16 (one new claim per uncovered area.
Tutor consequence
none yet

Attack record

5 attacks: 1 survived, 4 narrowed

2026-10-16 survived

Attack
If attending a knowledge-building (Core Knowledge) school, assigned by admission lottery, did not raise later reading/English-LA scores, C17's prong "building topic knowledge improves comprehension" would meet its kill-condition.
Target
kill-condition
Source
Grissmer et al. 2023 (preprint) | EdWorkingPaper 23-755, DOI 10.26300/nsbq-hb21
Steelmans to
C17 dies if knowledge-building teaching does not improve comprehension; a lottery comparison over grades 3–6 is a strong field test.
Why
Week run 2026-10-16, cycle 1 Europe/Stockholm. Full text read (ERIC ED672259, stored privately). 14 oversubscribed kindergarten lotteries, nine Colorado Core Knowledge charter schools, 2,310 applicants. Grade 3–6 English-LA ITT 0.143 SD (full sample), 0.179 and 0.241 SD in the authors' reduced samples; TOT 0.473. Kill-condition failed. Limits: outcome is the state English-LA test, not a pure comprehension test; whole-school effect, so not knowledge alone (authors call attribution an open question); boys' effects smaller and not significant in the full sample; oversubscribed schools only.

2026-10-18 narrowed

Attack
In a randomised trial in 17 English primary schools, a school year of a knowledge-rich curriculum adapted from Core Knowledge (Word and World Reading) did not raise pupils' scores on a standardised English test that includes reading comprehension (effect size −0.03), so building topic knowledge does not reliably improve comprehension.
Target
claim-text
Source
See, Gorard & Siddiqui 2017 | British Educational Research Journal 43(2), 372–393, DOI 10.1002/berj.3278
Steelmans to
C17's second prong ("building topic knowledge improves comprehension") is unqualified; this is an independent, school-randomised evaluation of exactly the Core Knowledge approach the prong rests on, run for a full school year with a standardised outcome, and the effect was zero (Year 3 −0.03, Year 4 −0.04; boys −0.13).
Why
Nightly-attacks 2026-10-18 Europe/Stockholm. DOI checked on Crossref (title, authors, BERJ 43(2) 372–393); journal full text behind a Cloudflare check from the box, so the full EEF evaluation report of the same trial by the same authors was read (ERIC ED581108; stored privately as ). Nine schools randomised to start at once, eight a year later (waitlist), Years 3 and 4, 2013–14. Post-test: long Progress in English (spelling, grammar, narrative and non-narrative comprehension, extended comprehension, writing; a protocol change requested by the developers). Gain scores 24.7 (treatment, n = 659) vs 25.1 (control), effect size −0.03 (p. 33, Table 4); −0.02 on age-standardised scores (Table 6); FSM pupils +0.06, not secure (p. 34). 287 post-tests missing (206 treatment, 81 control), 43% of them from one treatment school; baseline imbalance in FSM, EAL and SEN (p. 32). Kill withheld: a pilot that "did not seek to assess impact on attainment in a robust way" (p. 3), 17 schools, about 18% missing, uneven implementation, a general English outcome rather than comprehension of texts on the taught topics, one year only; Kim et al. 2021 and Grissmer et al. 2023 found gains. Narrowed: knowledge-building has improved comprehension in some trials, not consistently. Not a duplicate (only prior entry: Grissmer et al. 2023, a positive kill-condition test). Not a preprint. Status alive → weakened. Claim and Bounds rewritten same turn; brief and the practical rule rewritten.
Rewrite
claim-field+brief

2026-10-22 narrowed

Attack
In two school-randomised trials, the second a replication of the first (47 schools in two large urban US districts, 1,194 kindergarteners), a semester of the most widely used knowledge-building curriculum (Core Knowledge Language Arts: Knowledge Strand, one hour of topic read-alouds a day) taught the words and topics but left standardised listening comprehension unchanged in both trials (pooled Test of Narrative Language ES 0.027, 95% CI −0.092 to 0.147; CELF-4 Sentence Structure −0.031, −0.121 to 0.059), so knowledge-building teaching does not reliably improve comprehension.
Target
kill-condition
Source
Cabell, Kim, White, Gale, Edwards, Hwang, Petscher & Raines 2025 | Journal of Educational Psychology 117(2), 153–175, DOI 10.1037/edu0000916
Steelmans to
C17's kill-condition includes "knowledge-building teaching does not improve comprehension"; unlike the small English pilot already in the claim, this is a replicated, well-powered, school-randomised test with a true pre-randomisation baseline, minimal attrition and standardised comprehension outcomes, of Core Knowledge, the very approach the knowledge-building prong rests on, and the knowledge itself was clearly learned (taught vocabulary ES 0.56), yet comprehension did not move.
Why
Nightly-attacks 2026-10-22 Europe/Stockholm. DOI checked on Crossref (title, eight authors, JEP 117(2) 153–175, February 2025). The published article is open access at APA but its PDF sits behind an Incapsula bot check from the box and from the fetch tool, so the published abstract (University of Minnesota research portal) and the authors' 2020 structured report of the same two trials (Florida State University, public PDF, 6 pages with methods, results and a pooled table; stored privately as ) were read. Report: Study 1, 23 schools (11/12), mid-Atlantic district, 2017–18; Study 2, 24 schools (12/12), Southern district, 2018–19; 82% and 44% free or reduced-price lunch; pre-test before randomisation, baseline equivalence, minimal missing data, no differential attrition; ITT multilevel models; both studies "no discernable main effects on standardized measures of... listening comprehension" (p. 3); pooled Table 1: TNL 0.027 (p = .655), CELF-4 −0.031 (p = .502), PPVT 0.001, WJ-III Picture Vocabulary 0.085 (p = .016), WJ-III Science 0.116 (p = .044), WJ-III Social Studies 0.01, proximal vocabulary 0.559 (p < .001). The published abstract reports gains on proximal vocabulary and science and social-studies knowledge, and none on listening comprehension. Kill withheld: one semester only; kindergarten listening comprehension, not reading comprehension of texts; pooled numbers are the authors' preliminary estimates (the final article may differ slightly; not read); Kim et al. 2021 (first grade, listening comprehension ES .40) and Grissmer et al. 2023 found gains, and Hwang, Cabell & Joyner 2022 (abstract only) a positive meta-analytic average. Not a restatement: the existing consistency bound rests on one small pilot with about 18% missing results and a general English outcome (See et al. 2017); this is a replicated, low-attrition randomised null on a comprehension measure. Not a duplicate (prior entries: Grissmer et al. 2023, See et al. 2017). Not a preprint. Status stays weakened. Claim and Bounds rewritten same turn; brief and practical rule and limits rewritten (headline unchanged).
Rewrite
claim-field+brief

2026-10-30 narrowed

Attack
The upper end of C17's stated gain from teaching topic knowledge ("roughly 0.1 to 0.4 standard deviations" for "a school year or more") rests on a 10-day first-grade unit's four-item listening measure (Kim et al. 2021: ES .40, Cronbach's alpha .35), not on a school year of teaching; the same trial moved a general reading test by only ES .11, and the only school-year-or-longer randomised or lottery gains on file are 0.14 to 0.24 SD (Grissmer et al. 2023).
Target
claim-text
Source
Kim, Burkhauser, Mesite, Asher, Relyea, Fitzgerald & Elmore 2021 | Journal of Educational Psychology 113(1), 3–26, DOI 10.1037/edu0000465 (full text read 2026-10-30 from the Harvard CEPR author copy; Crossref-checked)
Steelmans to
C17's size range should describe what knowledge teaching does to general reading or comprehension tests over ordinary teaching; the 0.4 figure is a proximal, low-reliability listening measure after ten lessons, so a range topping out at 0.4 for a school year or more overstates the evidence on file.
Why
Nightly-attacks 2026-10-30 Europe/Stockholm. Full text: "MORE lessons included a 10-day thematic unit" (abstract); 38 first-grade classrooms, N = 674, ten 60-minute lessons within a 3-week window; listening comprehension = four inferential questions on one 189-word passage, reliability .35, ES .40; distal MAP reading ES .11 (Table 5). The school-year-or-longer evidence on file is Grissmer et al. 2023 (ITT 0.143; 0.241 reduced sample; working paper), See et al. 2017 (−0.03) and, for one semester, Cabell et al. 2025 (listening 0.027). The range shrinks, so this is a narrowing, not a correction. Not a duplicate (prior entries: Grissmer et al. 2023, See et al. 2017, Cabell et al. 2025, the 2026-10-29 sharpening); not a restatement of an existing Bound (Bounds gave Kim's ES .40 without its duration or measure). Not a preprint. Status stays weakened. Claim field, Bounds, brief and the practical rule rewritten in the same turn; headline unchanged (it was not stronger than the new claim).
Rewrite
claim-field+brief

2026-11-04 narrowed

Attack
The largest meta-analysis of causal studies of knowledge teaching and comprehension finds that knowledge-building teaching, as opposed to activating knowledge pupils already have, did not significantly improve reading comprehension (g = 0.19, p > .05), and that effects on norm-referenced tests (0.21) and in multi-group designs (0.18) are much smaller than on researcher-made tests or in single-class designs; so C17's "teaching topic knowledge has raised scores" rests on individual trials, not on a secure pooled effect of knowledge building.
Target
kill-condition
Source
Kim & Cao 2025 | Psychological Bulletin 151(10), 1219–1244, DOI 10.1037/bul0000502 (open access, CC BY-NC-ND; full text read on the Ovid article page and stored privately; Crossref-checked 2026-11-04)
Steelmans to
C17's kill line includes "knowledge-building teaching does not improve comprehension"; a 55-study causal meta-analysis is the strongest available test of that prong, and its estimate for knowledge building is not distinguishable from zero.
Why
Nightly-attacks run of 2026-11-04 Europe/Stockholm. Full text: causal data 55 studies, 304 effect sizes, N = 18,540; reading comprehension g = 0.44 (95% CI 0.18–0.70; 51 studies; I² = 97.75%); "knowledge activation instruction produced a statistically significant effect (g = 0.66, p < .01), while knowledge building instruction did not show a significant effect (g = 0.19, p > .05)", difference p = .045; normed tests g = 0.21 vs non-normed 0.51 (p < .01); non-N-of-1 designs 0.18 (p < .01) vs N-of-1 0.67; listening 0.13 (95% CI −0.41 to 0.68; 5 studies); grade, reading skill, SES not moderators; correlational r = .41 (108 studies). Kill withheld: a non-significant moderator estimate under very high heterogeneity is not a finding of no effect, the point estimate (0.19) lies inside the claim's 0.1–0.25 range, and the authors read both kinds of instruction as positive. Not a survival either: the prong the kill line names is not shown to hold in the pooled evidence, so the claim must say so. Not a duplicate (prior entries: Grissmer 2023, See 2017, Cabell 2025, the 2026-10-29 sharpening, Kim 2021, Reynolds 2024 correction); not a restatement (Bounds held only Hwang et al. 2022's abstract average of 0.25). Not a preprint. Status stays weakened. Kill-match check (the routing method): the new hedge concedes that the pooled knowledge-building estimate is not significant, not that knowledge building fails; prongs 1 (topic knowledge does not help once reading skill is accounted for) and 3 (strong readers without knowledge clearly beat weak readers with it) are untouched; not a kill-mismatch, but prong 2 is now close to conceded — flagged for Jonatan.
Rewrite
claim-field+brief

Corrections to our notes

These fix a number or a fact in our notes. They are not attacks and do not count toward the floor of 3 survivals.

Linked sources

9 linked sources (4 supports, 6 limits)

Supports (4)

SourceBasis
KNOW-005 · A Kindergarten Lottery Evaluation of Core Knowledge Charter Schools: Should Building General Knowledge Have a Central Role in Educational and Social Science Research and Policy? (2023 (EdWorkingPaper 23-755; working paper))Lottery-randomised Core Knowledge schooling raised grade 3–6 English-LA scores (ITT 0.14–0.24 SD).
KNOW-006 · Effects of Integrated Literacy and Content-area Instruction on Vocabulary and Comprehension in the Elementary Years: A Meta-analysis (2022 (online 2021))Meta-analysis of 35 (quasi)experimental K–5 studies: literacy taught through science/social-studies content raised comprehension (ES = 0.40), and standardised comprehension (ES = 0.25), with content knowledge ES = 0.89. Abstract only; includes quasi-experiments.
READ-010 · Improving reading comprehension, science domain knowledge, and reading engagement through a first-grade content literacy intervention (2021)Cluster RCT, 38 first-grade classrooms: knowledge-building units improved domain knowledge, listening comprehension and a distal reading-comprehension measure.
KNOW-001 · Effect of Prior Knowledge on Good and Poor Readers' Memory of Text (1988)Poor readers who knew baseball remembered a baseball passage better than good readers who did not.

Limits (6)

SourceBasis
KNOW-008 · Impact of a content-rich literacy curriculum on kindergarteners' vocabulary, listening comprehension, and content knowledge (2025)Two school-randomised trials, 47 US schools, 1,194 kindergarteners: a semester of Core Knowledge read-alouds (CKLA: Knowledge) taught the words and topics but did not improve standardised listening comprehension (pooled ES 0.03 and −0.03, ns; authors' 2020 report; published article not read). C17 weakened 2026-10-22 (consistency bound extended).
KNOW-011 · Content knowledge and comprehension: A meta-analytic review of correlational and causal associations (2025)Weakened C17 2026-11-04: 55 causal studies; knowledge-building teaching alone g = 0.19 on reading comprehension, not significant (knowledge activation 0.66, difference p = .045); norm-referenced tests 0.21; multi-group designs 0.18; listening 0.13 ns. Correlation knowledge–comprehension r = .41.
READ-010 · Improving reading comprehension, science domain knowledge, and reading engagement through a first-grade content literacy intervention (2021)Full text: a 10-lesson unit; the ES .40 was a four-item listening measure (alpha .35) and the general reading test rose ES .11 — narrowed C17's size range to about 0.1–0.25 SD (weakened 2026-10-30).
KNOW-010 · Fair or Foul? Interrogating the Role of Baseball Knowledge in Studies of Knowledge and Comprehension (2024)Review of 19 baseball studies: Recht & Leslie's groups were selected, not randomised, and split by sex; its knowledge test was 85% vocabulary with 15 of 39 items in the passage; the passage had almost no connectives. No counter-result (Bounds correction 2026-10-30).
KNOW-007 · Can explicit teaching of knowledge improve reading attainment? An evaluation of the Core Knowledge curriculum (2017)Randomised pilot, 17 English primary schools: a year of a Core Knowledge-based curriculum (Word and World Reading, ages 7–9) left a standardised English test that included reading comprehension unchanged (effect size −0.03; ~18% missing). C17 weakened 2026-10-18 (consistency bound).
KNOW-009 · The Importance of Knowledge for Reading Comprehension: A Quasi-Experimental Investigation (2026)Quasi-experiment, one complete Year 2 cohort (n = 73, Australia): explicitly taught topic knowledge let both skilled and less skilled readers make inferences in a related text, but less skilled readers mastered less of the knowledge in the same time and lost more of the benefit when reading came after a delay. Abstract only; no effect sizes in the abstract.

Review state: first-pass draft, pending human review.