measuring differences in the quality of professional development
DESCRIPTION
Symposium - Evaluating the Quality of Professional Development: Implications for Districts and States. Measuring Differences in the Quality of Professional Development. Michael S. Garet Kwang Suk Yoon A merican I nstitutes for R esearch Andrew C. Porter Vanderbilt University. Focus. - PowerPoint PPT PresentationTRANSCRIPT
Measuring Differences in Measuring Differences in the Quality of Professional the Quality of Professional
DevelopmentDevelopment
Michael S. Garet
Kwang Suk YoonAmerican Institutes for Research
Andrew C. PorterVanderbilt University
Symposium - Evaluating the Quality of Professional Development: Symposium - Evaluating the Quality of Professional Development: Implications for Districts and StatesImplications for Districts and States
FocusFocus
How to conceptualize and measure the full set of professional development experiences districts offer and teachers participate in
Levels of analysisLevels of analysis
District portfolio of Professional Development (PD)
Specific PD activitiesSpecific time-periods during which
PD takes place (months, semesters)Teacher collection of PD experiences
Levels of analysis (continued)Levels of analysis (continued)
District Portfolio Other PD
A1 A2 A3 A4
tp1 tp1 tp2 tp1 tp1 tp2 tp3tp2
Teacher 1 PD Teacher 2 PD
Features of PD activitiesFeatures of PD activities
Structural features– Type – Duration (contact hours and span)– Collective participation
Core features– Content focus– Active learning– Coherence
Design of MSP evaluationDesign of MSP evaluation
4 MSP projects
Within each project, 2 groups of teachers– Treatment group: teachers targeted for MSP
participation– Comparison group: matched teachers or
schools
Design of MSP evaluation (cont)Design of MSP evaluation (cont)
Data on professional development collected through Professional Development Activity Log (PDAL)– teachers provide 1 log on each activity
each month– data collected for 15 months (July 2003
- October 2004)
Professional Development Activity Log Professional Development Activity Log (PDAL)(PDAL)
The PDAL is a web-based, self-administered, longitudinal data collection tool for teachers to record their professional development experiences in detail with the assistance of a series of structured prompts
Teachers log on to their password-protected web account and fill out their PDAL at regular intervals
Visit www.PDAL.net for more information
PDAL data structurePDAL data structure(teacher by activity by month)(teacher by activity by month)
Teacher Activity Jul-03 Aug-03 Sep-03 Oct-03 Nov-03 Dec-03 Jan-04 Feb-04 No. of Logs
Mr. Anderson A 1 1 - - - - - - 2
B - - 1 - 1 - 1 - 3
C - - - - 1 - - - 1
Ms. Lopez A 1 1 - - - - - - 2
D - - - - 1 1 1 1 4
Mrs. Kelly E - 1 1 - - - - - 2
Mr. Lee E 1 1 1 - - - - - 3
F - - 1 1 - - - - 2
Mrs. Smith G - - - - 1 - - - 1
No. of logs 3 4 4 1 4 1 2 1 20
Contact HoursContact Hours(teacher by activity by month)(teacher by activity by month)
Teacher Activity Jul-03 Aug-03 Sep-03 Oct-03 Nov-03 Dec-03 Jan-04 Feb-04
# of contact hours
Mr. Lee E 10 5 5 0 0 0 nd nd 20F 0 0 5 5 0 0 nd nd 10
total 10 5 10 5 0 0 nd nd 30
% of months with PD (math)% of months with PD (math)
0%
20%
40%
60%
80%
100%
Site 1 Site 2 Site 3 Site 4
Per
cent
of m
onth
s
ComparisonTreatment
Contact hours by calendar monthContact hours by calendar month
0
10
20
30
40
Hou
rs p
er a
ctiv
ity
per
mon
th
Contact hours per month (math)Contact hours per month (math)
0
5
10
15
20
25
Site 1 Site 2 Site 3 Site 4
Hou
rs p
er m
onth
ComparisonTreatment
Topic intensity (science)Topic intensity (science)
0
5
10
15
20
25
Site 1 Site 2 Site 3 Site 4
Hou
rs p
er t
opic
per
mon
th
ComparisonTreatment
Next stepsNext steps
1. Exploring teachers’ PD experiences– Is there a relationship between PD
participation and change in instructional practice and achievement? Which teachers receive high-quality PD?
Next steps (cont.)Next steps (cont.)
2. Using the PDAL to examine specific PD activities and portfolios.– Do MSP activities have the intended
features? Are some activities of particularly high quality?
3. Examining the reliability and validity of the PDAL
Contact InformationContact Information
Michael S. [email protected]
Kwang Suk [email protected]
Andrew C. [email protected]
Visit us
www.PDAL.net