![Page 1: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/1.jpg)
Dylan Wiliam (@dylanwiliam)
National Teaching Policy:
What is the key?
www.dylanwiliamcenter.com
![Page 2: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/2.jpg)
Outline: three issues
• Teacher quality
– what it is
– why it matters
– how to get more of it
• Assessment
– The bridge between teaching and learning
– Different approaches to formative assessment
• Leadership for teacher learning
– Content, then process
– Making teacher learning the priority
2
![Page 3: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/3.jpg)
Teacher quality
3
![Page 4: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/4.jpg)
Teaching quality vs. teacher quality4
• Teaching quality depends on a number of factors
– The time teachers have to plan teaching
– The size of classes
– The resources available• Material resources
• Collegial support
– The skills of the teacher
• All of these are important, but the quality of the teacher seems to be especially important
![Page 5: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/5.jpg)
Teacher quality and student achievement
Study Location Reading Math
Rockoff (2004) New Jersey 0.10 0.11
Nye, Konstantopoulos, Hedges (2004) Tennessee 0.26 0.36
Rivkin, Hanushek, and Kain (2005) Texas 0.15 0.11
Aaronson, Barrow, and Sander (2007) Chicago 0.13
Kane, Rockoff, and Staiger (2008) New York City 0.08 0.11
Jacob and Lefgren (2008) 0.12 0.26
Kane and Staiger (2008) 0.18 0.22
Koedel and Betts (2009) San Diego 0.23
Rothstein (2010) North Carolina 0.11 0.15
Hanushek and Rivkin (2010) 0.11
Chetty et al. (2014) 0.12 0.16
Hanushek and Rivkin (2010)*
![Page 6: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/6.jpg)
Annual growth in achievement, by age6
0,0
0,2
0,4
0,6
0,8
1,0
1,2
1,4
1,6
5 6 7 8 9 10 11 12 13 14 15 16
ann
ual
gro
wth
(SD
s)
Age
Bloom, Hill, Black, and Lipsey (2008)
![Page 7: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/7.jpg)
7
• Assuming that
– one year’s student growth is 0.3 standard deviations
– the correlation between teacher quality and student achievement is 0.15
• Then with a good teacher (1sd above the mean) students learn 50% more
• And with an outstanding teacher (2sd above the mean) they learn 100% more
• Note also that students make some progress through maturation so these are probably underestimates of the true effect (Fitzpatrick, Grissmer, & Hastedt, 2011)
![Page 8: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/8.jpg)
Teacher quality8
• The impact of teacher quality (Hanushek & Rivkin, 2006)– In the classroom of the best teacher in a group of 50 teachers,
students learn twice as fast as average.
– In the classroom of the least effective teacher in a group of 50, students learn half as fast as average
– And in the classrooms of the best teachers, students from disadvantaged backgrounds learn as much as others (Hamre & Pianta, 2005)
• Teachers make a difference
• But what makes the difference in teachers?– In particular, can we predict student progress from:
• Teacher qualifications?
• Value-added?
• Teacher observation?
![Page 9: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/9.jpg)
Teacher qualifications
9
![Page 10: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/10.jpg)
Teacher qualifications and student progress10
Mathematics Reading
Primary Middle High Primary Middle High
General theory of education courses
Teaching practice courses
Pedagogical content courses
Advanced university courses
Aptitude test scores
Harris and Sass (2007)
Mathematics Reading
Primary Middle High Primary Middle High
General theory of education courses —Teaching practice courses — +Pedagogical content courses + +Advanced university courses — +Aptitude test scores —
![Page 11: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/11.jpg)
Teacher observations
11
![Page 12: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/12.jpg)
Framework for teaching (Danielson 1996)
• Four domains of professional practice
1. Planning and preparation
2. Classroom environment
3. Instruction
4. Professional responsibilities
• Links with student achievement (Sartain, et al. 2011)
– Domains 1 and 4: no impact on student achievement
– Domains 2 and 3: some impact on student achievement
12
![Page 13: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/13.jpg)
A framework for teaching (Danielson, 1996)
• Domain 2: The classroom environment– 2a: Creating an environment of respect and rapport– 2b: Establishing a culture for learning– 2c: Managing classroom procedures– 2d: Managing student behavior– 2e: Organizing physical space
• Domain 3: Instruction– 3a: Communicating with students– 3b: Using questioning and discussion techniques– 3c: Engaging students in learning– 3d: Using assessment in instruction– 3e: Demonstrating flexibility and responsiveness
![Page 14: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/14.jpg)
Observations and teacher quality14
-15
-10
-5
0
5
10
15
20
Unsatisfactory Basic Proficient DistinguishedPe
rce
nta
ge c
han
ge in
rat
e o
f le
arn
ing
Reading Mathematics
Sartain, Stoelinga, Brown, Luppescu, Matsko, Miller, Durwood, Jiang, and Glazer (2011)
So, the highest rated teachers are 30% more productive than the lowest rated
But the best teachers are 400% more productive than the least effective
![Page 15: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/15.jpg)
Imprecision of lesson observations
Achieving a reliability of 0.9 in judging teacher quality through lesson observation is likely to require observing a teacher teaching 6 different classes, and for each lesson to be judged by 5 independent observers.
Hill, Charalambous and Kraft (2012)
15
![Page 16: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/16.jpg)
What we know about teacher observation16
• To recap
– The highest rated teachers generate learning 30% faster than the lowest rated teachers
– But the most effective teachers generate learning 400% faster than the least effective teachers
– So the best observation systems we have capture less than 10% of teacher quality (in reality, less than this because most teachers are in the middle two categories)
![Page 17: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/17.jpg)
Teacher value-added
17
![Page 18: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/18.jpg)
Teacher value-added
Value-added quintile: Student fixed-effects model
Val
ue
-ad
de
d q
uin
tile
: Tr
adit
ion
al m
od
el
1 2 3 4 5
1 38 22 24 16 0
2 26 28 15 20 11
3 20 20 20 24 16
4 13 24 26 13 24
5 9 5 12 28 47
Goldhaber, Goldschmidt, and Tseng (2013)
![Page 19: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/19.jpg)
Mathematics
-0,3
-0,2
-0,1
0
0,1
0,2
0,3
0,4
0,5
0 1 2 3 4
Val
ue
-ad
de
d (
stu
de
nt
SDs)
Years of teaching experience
Quintile of teacher value-added
5th 4th 3rd 2nd 1st
Atteberry, Loeb and Wyckoff (2013)
![Page 20: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/20.jpg)
Correlation of initial and later performance20
0
0,1
0,2
0,3
0,4
0,5
Base+1 Base+2 Base+3 Base+4 Base+5Co
rre
lati
on
of
valu
e-a
dd
ed
wit
h b
ase
ye
ar
Year of prediction
All teachers New teachers
Mathematics
![Page 21: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/21.jpg)
Correlation of initial and later performance21
0
0,1
0,2
0,3
0,4
0,5
Base+1 Base+2 Base+3 Base+4 Base+5Co
rre
lati
on
of
valu
e-a
dd
ed
wit
h b
ase
ye
ar
Year of prediction
All teachers New teachers
Reading
![Page 22: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/22.jpg)
Issues with value-added models for teachers22
• Different (reasonable) models of value-added give very different estimates of teacher quality (Goldhaber, Goldschmidt and Tseng, 2013)
• Teacher value-added in their first year accounts for less than 5% of the variation in teacher quality in their fifth year of teaching (Atteberry, Loeb and Wyckoff, 2013)
• Teachers benefit students for at least three years after they stop teaching them (Rothstein, 2010)
![Page 23: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/23.jpg)
To sum up…
• We cannot accurately evaluate teachers
– From their qualifications
– By observing them
– By measuring their impact on student achievement
– From a combination of all of these measures
• We would be better off spending our time improving our teachers than evaluating them
• But what should teachers improve?
23
![Page 24: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/24.jpg)
So what should teachers improve?
• In education, meta-analysis is an unreliable guide
– File drawer problem
– Selection of studies
– Dosage/intensity
– Variation in variability
– Sensitivity to instruction
• Best-evidence synthesis
24
![Page 25: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/25.jpg)
The relationship of formative assessment to other policy priorities
25
![Page 26: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/26.jpg)
The evidence base for formative assessment
• Fuchs & Fuchs (1986)
• Natriello (1987)
• Crooks (1988)
• Bangert-Drowns, et al. (1991)
• Dempster (1991, 1992)
• Elshout-Mohr (1994)
• Kluger & DeNisi (1996)
• Black & Wiliam (1998)
• Nyquist (2003)
• Brookhart (2004)
• Allal & Lopez (2005)
• Köller (2005)
• Brookhart (2007)
• Wiliam (2007)
• Hattie & Timperley (2007)
• Shute (2008)
26
![Page 27: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/27.jpg)
Recent meta-analytic findings
Content area N 95% confidence interval for effect size
Lower Mean Upper
Mathematics 19 0.14 0.17 0.20
English Language Arts 4 0.30 0.32 0.34
Science 17 0.06 0.19 0.31
Total 40
Mean effect size ≈ 0.20
A big effect size
Equivalent to a 50% to 70% increase in the rate of learning
Kingston and Nash (2011, 2015)
27
![Page 28: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/28.jpg)
Formative Assessment: A contested term
Span
Length
Impact
Long-cycle Medium-cycle Short-cycle
Across terms, teaching units
Four weeks toone year
Monitoring, curriculum alignment
Within and between lessons
Minute-by-minute and day-by-day
Engagement, responsiveness
Within and between
teaching units
One to four weeks
Student-involved
assessment
28
![Page 29: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/29.jpg)
Where the learner is going
Where the learneris now
How to get the learner there
Teacher
Peer
Student
Unpacking Formative Assessment
Clarifying, sharing, and
understanding learning
intentions
Engineering effective discussions, tasks, and activities that elicit evidence of
learning
Providing feedbackthat moves learners
forward
Activating students asresources for one another
Activating students asowners of their own learning
![Page 30: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/30.jpg)
Where the learner is going
Where the learneris now
How to get the learner there
Teacher
Peer
Student
Unpacking Formative Assessment
Using evidence of achievement to adapt what happens in classrooms to
meet learner needs
![Page 31: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/31.jpg)
An educational positioning system
• A good teacher:
– Establishes where the students are in their learning
– Identifies the learning destination
– Carefully plans a route
– Begins the learning journey
– Makes regular checks on progress on the way
– Makes adjustments to the course as conditions dictate
31
![Page 32: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/32.jpg)
The relationship of formative assessment to other policy priorities
32
![Page 33: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/33.jpg)
Educational Endowment Foundation toolkit33
Intervention Cost Quality of evidence
Extra months of learning
Feedback ££ +8
Metacognition and self-regulation ££ +8
Peer tutoring ££ +6
Early years intervention £££££ +6
One to one tuition ££££ +5
Homework (secondary) £ +5
Collaborative learning £ +5
Phonics £ +4
Small group tuition £££ +4
Behaviour interventions £££ +4
Digital technology ££££ +4
Social and emotional learning £ +4
![Page 34: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/34.jpg)
Educational Endowment Foundation toolkit34
Intervention Cost Quality of evidence
Extra months of learning
Parental involvement £££ +3
Reducing class size £££££ +3
Summer schools £££ +3
Sports participation £££ +2
Arts participation ££ +2
Extended school time £££ +2
Individualized instruction £ +2
After school programmes ££££ +2
Learning styles £ +2
Mentoring £££ +1
Homework (primary) £ +1
![Page 35: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/35.jpg)
Educational Endowment Foundation toolkit35
Intervention Cost Quality of evidence
Extra months of learning
Teaching assistants ££££ 0
Performance pay ££ 0
Aspiration interventions £££ 0
Block scheduling £ 0
School uniform £ 0
Physical environment ££ 0
Ability grouping £ -1
![Page 36: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/36.jpg)
Where the learner is going
Where the learneris now
How to get the learner there
Teacher
Peer
Student
Unpacking Formative Assessment
Clarifying, sharing, and
understanding learning
intentions
Eliciting evidence of learning
Providing feedback that
moves learners forward
Activating students asresources for one another
Activating students asowners of their own learning
36
![Page 37: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/37.jpg)
So much for the easy bit
![Page 38: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/38.jpg)
A model for teacher learning
• Content, then process
• Content (what we want teachers to change):
– Evidence
– Ideas (strategies and techniques)
• Process (how to go about change):
– Choice
– Flexibility
– Small steps
– Accountability
– Support
38
![Page 39: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/39.jpg)
Supportive accountability
• What is needed from teachers:
– A commitment to:• The continual improvement of practice
• Focus on those things that make a difference to students
• What is needed from leaders:
– A commitment to engineer effective learning environments for teachers by:• Creating expectations for continually improving practice
• Keeping the focus on the things that make a difference to students
• Providing the time, space, dispensation, and support for innovation
• Supporting risk-taking
39
![Page 40: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/40.jpg)
Thank you
www.dylanwiliam.net
![Page 41: National Teaching Policy: What is the key?€¦ · •To recap –The highest rated teachers generate learning 30% faster than the lowest rated teachers –But the most effective](https://reader034.vdocuments.us/reader034/viewer/2022042411/5f29943fdc377040705df32c/html5/thumbnails/41.jpg)
For more information, please visit
DylanWiliamCenter.com