what can social science contribute to educational policy? peter tymms durham uk
TRANSCRIPT
![Page 1: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/1.jpg)
What can Social Science Contribute to Educational
Policy?
Peter Tymms
Durham
UK
![Page 2: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/2.jpg)
Overview
• Effectiveness of policies & cost
• How can research help
• Where the action lies
• Two interventions
• What is needed
![Page 3: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/3.jpg)
![Page 4: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/4.jpg)
Impact of UK Policy Initiatives: One example
![Page 5: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/5.jpg)
40
50
60
70
80
90
1995 1996 1997 1998 1999 2000 2001 2002 2003 2004
Perc
ent l
evel
4 and
abov
e
KS2 maths
KS2 English
2000
KS2 Percent With Level 4+
![Page 6: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/6.jpg)
Independent data from:
• Thirteen independent studies
• Two thirds of a million assessments
![Page 7: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/7.jpg)
40
50
60
70
80
9019
95
1996
1997
1998
1999
2000
2001
2002
2003
2004
MathsEnglish
What really happened
![Page 8: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/8.jpg)
Summary
• Reading improvements were “largely illusory”
• Maths improvements were modest
![Page 9: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/9.jpg)
Why the issue is important
• Cost: £500,0000 on the NLS
• “Large scale reform is not only possible but can be achieved quickly”
Michael Barber Education Week 15/11/00
• National Audit Office in Modern Policy
Took the NLS to draw lessons about successful policy making.
![Page 10: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/10.jpg)
The pendulum swings and ..
• History is littered with educational initiatives that have had no impact.
• USA: Billions of dollars have been spent on reading with no impact.
![Page 11: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/11.jpg)
How can research help?
• Providing an overview – Low level generalisations (Scriven)
• For practitioners• For policy makers
• Providing feedback through– Monitoring – Evaluation
• Researching– What works– NB Unit of Investigation
![Page 12: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/12.jpg)
What is most important?
• For the progress and attitudes of students – The district– The school– The principal – The teacher
![Page 13: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/13.jpg)
The Newcastle Commission
A political promise
![Page 14: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/14.jpg)
Data Sources
• Several national datasets including
– ASPECTS, PIPS, MidYIS & YELLIS – plus KS1, KS2, KS3 & GCSE
• Looked a value-added using 3 level multilevel models
![Page 15: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/15.jpg)
English Official Assessments
• A level
• GCSE
• End of KS3
• End of KS2
• End of KS1
• FSP
ALIS
YELLIS
MIDYIS
PIPS
ASPECTS
![Page 16: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/16.jpg)
Pupil raw Pupil value-added
School raw
School value added
LEA raw LEA value added
-3.00
-2.00
-1.00
0.00
1.00
2.00
![Page 17: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/17.jpg)
Pupil raw Pupil value-added
School raw
School value added
LEA raw LEA value added
-3.00
-2.00
-1.00
0.00
1.00
2.00
![Page 18: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/18.jpg)
Pupil raw Pupil value-added
School raw
School value added
LEA raw LEA value added
-3.00
-2.00
-1.00
0.00
1.00
2.00
![Page 19: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/19.jpg)
Pupil raw Pupil value-added
School raw
School value added
LEA raw LEA value added
-3.00
-2.00
-1.00
0.00
1.00
2.00
![Page 20: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/20.jpg)
Pupil raw Pupil value-added
School raw
School value added
LEA raw LEA value added
-3.00
-2.00
-1.00
0.00
1.00
2.00
![Page 21: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/21.jpg)
Pupil raw Pupil value-added
School raw
School value added
LEA raw LEA value added
-3.00
-2.00
-1.00
0.00
1.00
2.00
![Page 22: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/22.jpg)
Learning
0
0.1
0.2
0.3
0.4
0.5
0.6
District School Principal Teacher
![Page 23: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/23.jpg)
Two example of research into what works
But what should the unit of investigation be?
![Page 24: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/24.jpg)
First Intervention
• Teachers rate pupils aged 5 on their ADHD symptoms.
• High scoring pupils fall behind for years to come
![Page 25: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/25.jpg)
Interventions
• Randomly assign to schools
Identification No Identification
Booklet
No Booklet
![Page 26: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/26.jpg)
Interventions
• Randomly assigned to LEAs
Nothing Information packs
Conference & packs
![Page 27: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/27.jpg)
Numbers
• 24 Authorities
• 2040 schools
• 60,000 pupils
• Over 2 years
![Page 28: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/28.jpg)
Results
• LEA Interventions – No impact on any of the outcome measures
For booklet– Higher Y2 reading scores across all pupils– Better behaviour for pupils with ADHD characteristics– More positive teachers
• Identification– No impact
• Interaction– Negative and puzzling
![Page 29: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/29.jpg)
Second Intervention: Peer Tutoring
![Page 30: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/30.jpg)
We know that ..
Peer Learning enhances learning
But
Can a whole Authority change?
![Page 31: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/31.jpg)
Compare• Fife-in-the-future with Fife-in-the-past• Cross-age with same-age• Separate and mixed approaches?• Intensive and selective approaches?
And
• The schools have agreed to be randomly assigned to interventions.
![Page 32: What can Social Science Contribute to Educational Policy? Peter Tymms Durham UK](https://reader035.vdocuments.us/reader035/viewer/2022070407/56649e355503460f94b240e7/html5/thumbnails/32.jpg)
Where do we go?
• Get and retain good teachers• Use the methods of science to
– Monitor– Evaluate– Investigate using RCTs at the school & LEA levels
• And in the future– Use diagnostic computer adaptive assessments– Create simulations– Reforms as experiments (Campbell)