improving reading comprehension : effects from interventions
DESCRIPTION
Improving reading comprehension : Effects from interventions. Monica Melby-Lervåg. My talk. 1. The foundation of reading comprehension 2. Reading comprehension and dyslexia 3 . To examine the effects from an intervention - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/1.jpg)
Improving reading comprehension: Effects from interventions
Monica Melby-Lervåg
![Page 2: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/2.jpg)
![Page 3: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/3.jpg)
My talk1. The foundation of reading comprehension 2. Reading comprehension and dyslexia3. To examine the effects from an intervention4. Effects from interventions directly targeting reading comprehension 5. Effects from interventions targeting underlying components of reading comprehension (general cognitive processes, decoding, vocabulary).
![Page 4: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/4.jpg)
1. The foundation of reading comprehension
![Page 5: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/5.jpg)
Background
Reading comprehension = Word decoding Linguistic Comprehension
working memory?
Inference skills?
Morphology?
Syntax?
![Page 6: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/6.jpg)
The study
198 unselected Norwegian speaking children
Assessment scheme
Middle of 2nd grade
End of 2nd
grade
Middle of 3rd grade
End of 3rd
grade
Middle of 6th grade
Middle of 7th grade
Lervåg & Melby-Lervåg, work in progress
![Page 7: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/7.jpg)
![Page 8: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/8.jpg)
![Page 9: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/9.jpg)
![Page 11: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/11.jpg)
NARA T2 NARA T3 NARA T4 NARA T5 NARA T6NARA T1
Morpheme Generation
Syntactic Skills
Vocabulary Width
Inference Skills TOWRE A TOWRE B
Listening Recall
Backward Digit Recall
Vocabulary Definitions
Vocab. Width
Residual
Syntac. Skills
Residual
Morph. Gen..
Residual
Inf. Skills Residual
Vocab. Def.
Residual
Linguistic Comprehension
Word Decoding
Working Memory
Reading Comprehension
Initial Status
Reading Comprehension
Early Growth
Reading Comprehension
Later Growth
3.55**
2.21**.735*1.02**
.614**
-.20**
.622*
.058*
![Page 12: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/12.jpg)
![Page 13: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/13.jpg)
2. Reading comprehension and dyslexia
![Page 14: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/14.jpg)
FAMILY RISK OF DYSLEXIA
![Page 15: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/15.jpg)
StudyMeta-analysis of studies examining reading comprehension and underlying skills in children with dyslexia (Snowling & Melby-Lervåg, submitted)
A systematic search detected 123 studies that used a family risk methodology to study reading
disorders
![Page 16: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/16.jpg)
Effect size
Effect size
Cohens d
Example d = -1.00
![Page 17: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/17.jpg)
Results
0
0.2
0.4
0.6
0.8
1
1.2
Family risk children without dyslexia vs controls not at –risk
Toddlers (1- 3.5 years)
Articulatory accuracy Expressive language Receptive language
Family risk children with dyslexia vs controls not at –risk
Gro
up d
iffer
ence
d (S
TD u
nits
)
![Page 18: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/18.jpg)
Preschool
0
0.2
0.4
0.6
0.8
1
1.2
Family risk children with dyslexia vs controls not at –risk
Family risk children with out dyslexia vs controls not at –risk
Articulatory accuracy
Receptive vocabulary
grammar Phoneme awareness
Rapid naming
Gro
up d
iffer
ence
d (S
TD u
nits
)
![Page 19: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/19.jpg)
Primary school
0
0.5
1
1.5
2
2.5
3Family risk children with dyslexia vs controls not at –risk
Family risk children with out dyslexia vs controls not at –risk
Expressive vocabulary
Phoneme awareness
Rapid naming
Word decoding
Reading comprehension
Gro
up d
iffe
renc
e d
(ST
D u
nits
)
![Page 20: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/20.jpg)
![Page 21: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/21.jpg)
3. To examine the effects from an intervention
![Page 22: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/22.jpg)
PretestChose a group of children
Intervention Posttest
![Page 23: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/23.jpg)
PretestChose a group of children
Intervention Posttest
![Page 24: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/24.jpg)
PretestChose a group of children
Intervention
PosttestNo intervention/irrelevant intervention
Randomize the children in a training and an intervention group
Posttest
Pretest
![Page 25: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/25.jpg)
Study:
A syntehesis of meta-analyses
Melby-Lervåg, Lervåg & Hulme, work in progress.
![Page 26: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/26.jpg)
MethodSystematic search for reviews of educational interventions that have used a quantitative summary of results after 1998
The meta-analysis had to examine an intervention that could in some way inform about amelioration of difficulties related to: Decoding, reading comprehension, language skills, mathematic skills, general learning disorders, attention/hyperactivity, other behavioral/emotional problems or bullying.
The meta-analysis had to provide a mean effect size of an academic achievement or behavioral outcome that was based on a group design (i.e. meta-analyses purely based on single case studies were excluded)
70 meta-analyses included, 3145 single studies
Melby-Lervåg, Lervåg & Hulme, work in progress.
![Page 27: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/27.jpg)
Differences in mean effect size for different designs
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
RCT QED with control group
No control group
Mea
n ef
fect
siz
e in
met
a-an
alys
es
![Page 28: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/28.jpg)
Only 233 of the 3145 intervention studies were randomised controlled trials.
Serious methodological weaknesses, studies not suited to conclude about
intervention effects
![Page 29: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/29.jpg)
5. Effects from interventions targeting reading comprehension or underlying components of
reading comprehension
![Page 30: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/30.jpg)
![Page 31: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/31.jpg)
A. Interventions targeting reading comprehension directly
![Page 32: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/32.jpg)
Clarke, Snowling, Truelove og Hulme (2010) Compared three interventions for 160 children in 4th grade.
Selected on the basis of a reading comprehension screening of 1200 children.
Intervention:1. Linguistic comprehension
2. Reading comprehension 3. Combined
-Vocabulary (60 new words)-Narratives-Oral language use-Listening comprehension
-Meta-cognitive strategies (repeated reading, thinking aloud, visualisation) -Use of these strategies when reading text and in questions -Inferences, rcognise and use- Narratives and txt production
A combination (50/50 %).
![Page 33: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/33.jpg)
Results
Figure from the paper:
![Page 34: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/34.jpg)
B. Interventions targeting reading comprehension indirectly through Domain
General Cognitive Skills
![Page 35: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/35.jpg)
Effects from computerised working memory training
![Page 36: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/36.jpg)
![Page 37: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/37.jpg)
Study
Redick, Melby-Lervåg & Hulme (work in progress). 2012: 23 studies
New study: 82 studies with 102 independent experiments
![Page 38: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/38.jpg)
NARA T2 NARA T3 NARA T4 NARA T5 NARA T6NARA T1
Morpheme Generation
Syntactic Skills
Vocabulary Width
Inference Skills TOWRE A TOWRE B
Listening Recall
Backward Digit Recall
Vocabulary Definitions
Vocab. Width
Residual
Syntac. Skills
Residual
Morph. Gen..
Residual
Inf. Skills Residual
Vocab. Def.
Residual
Linguistic Comprehension
Word Decoding
Working Memory
Reading Comprehension
Initial Status
Reading Comprehension
Early Growth
Reading Comprehension
Later Growth
3.55**
2.21**.735*1.02**
.614**
-.20**
.622*
.058*
![Page 39: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/39.jpg)
ResultsDecoding
Studies
Treated controls
Untreated controls
Mean effect size d immediatly after training
![Page 40: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/40.jpg)
Verbal abilities
StudiesMean effect size d immediatly after training
Treated controls
Untreated controls
![Page 41: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/41.jpg)
Reading comprehensionStudies Mean effect size d immediatly after
trainingTreated controls
Untreated controls
![Page 42: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/42.jpg)
Similar findings for auditory processing training
![Page 43: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/43.jpg)
C. Interventions targeting reading comprehension indirectly through decoding/phonological awareness
![Page 44: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/44.jpg)
Numerous of well controlled studies have shown that phonological awareness in combination
with letter knowledge training can improve word decoding skills………..
Unfortunatly, not that many have reported transfer effects to standardised tests of reading comprehension
![Page 45: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/45.jpg)
10 studies met inclusion criteria for word decoding. Effects were moderate: 0.47 SD better (95% CI 0.06 to 0.88)
Only three studies reported data on transfer effects to reading comprehension: 0.14 SD better (95% CI -0.46 to 0.74)
![Page 46: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/46.jpg)
RCTs that combine phonological awareness/letter knowledge and vocabulary
intervention shows promising effects on reading comprehension
Wolff, 2011(d = 0.41, lasted at
follow up)
![Page 47: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/47.jpg)
D. Interventions targeting reading comprehension indirectly through
vocabulary/linguistic comprehension
![Page 48: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/48.jpg)
Linguistic comprehension intervention
Three times a week, (2 x 45 minutes, 1 x 10 min individually).
Rogde, Melby-Lervåg & Lervåg (submitted)
Dialogical readingNarrative skills
Expressive language tasks
Vocabulary instruction
115 second language learners randomised in two groups. Training group received 20 weeks of intervention
![Page 49: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/49.jpg)
Vocabulary embedded in the training program
0
1
2 0
2
4
6
8
10
12
14
16
18
20
Group CONTROL
Group TRAINING
d = 0.53** immediatly after training, d = 0.44* follow up
![Page 50: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/50.jpg)
Distal measures: Do the effects of training transfer to standardized tests of expressive language?
0
1
2 0
2
4
6
8
10
12
14
16
18
20
Group CONTROL
Group TRAINING
0
1
2 0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
Group CONTROL
Group TRAINING
d = 0.51** immediatly after training, d = 0.28 (p = 0.064) follow up
![Page 51: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/51.jpg)
Distal measures: Do the effects of training transfer to standardized tests of receptive language?
0
1
2 0
5
10
15
20
25
30
35
40
45
50
55
60
65
70
75
Group CONTROL
Group TRAINING
0
1
2 0
5
10
15
20
25
30
35
40
45
50
55
60
Group CONTROL
Group TRAINING
d = 0.02 immediatly after training, d = 0.06 follow up
![Page 52: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/52.jpg)
My talk1. The foundation of reading comprehension 2. Reading comprehension and dyslexia3. To examine the effects from an intervention4. Effects from interventions directly targeting reading comprehension 5. Effects from interventions targeting underlying components of reading comprehension (general cognitive processes, decoding, vocabulary).
![Page 53: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/53.jpg)
Take-home message 1From family risk studies of dyslexia it is clear that children with dyslexia have impared word decoding and reading comprehension skills. From an early age they also have poor phonological awareness and often also broader language skills.
From longitudinal studies we know that vocabulary, grammar skills and word decoding are uniqly related to the growth in reading comprehension.
Thus, for interventions to be succsessfull they should focus on these areas.
![Page 54: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/54.jpg)
Take-home message 2
Effects on reading comprehension can be obtained by interventions either focusing on reading comprehesion directly (strategies etc), through linguisitc comprehension/vocabulary or through decoding/phonological awareness. But…Effects are not easily obtained. Requires hard and systematic work over time.
![Page 55: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/55.jpg)
Take-home message 3
Reading comprehension is the ultimate goal of literacy. Therefore more studies should focus on this and measure this with standardised tests that has good psychometric properties.
There is a great need in education for high quality randomised intervention studies. Many studies have used poor designs, too few participants and interventions lacking a theoretical and empirical rationale. This has given us misleading results and lead us astray.
![Page 56: Improving reading comprehension : Effects from interventions](https://reader031.vdocuments.us/reader031/viewer/2022012916/56812b92550346895d8fb00c/html5/thumbnails/56.jpg)
Foto: Kathrine Nordli, «Airborne»
Thank you for the attention!