dre fldoe “value-added model” school district of palm beach county performance accountability
TRANSCRIPT
DRE
FLDOE “Value-Added Model”FLDOE “Value-Added Model”
School District of Palm Beach CountyPerformance Accountability
DRE
Background: FLDOE Value-Added Model
• Established by Student Success Act (SB 736)
• Developed by committee of teachers, principals, parents, union representatives, superintendents, school board members, district administrators and postsecondary faculty
DRE
What is the FLDOE “Value-Added Model”?
DRE
The AnswerFlorida
Model
DRE
Thank you for your attention.
Do you have any questions?
DRE
FLDOE Value-Added Model
• Teacher Component
• School Component
• Based on Student Learning Growth
– Predictions cannot be different based on student’s gender, race, ethnicity, or socioeconomic status
DRE
FLDOE Value-Added Model Variables determining student learning growth
• Two or more years of prior achievement scores • Gifted status • Attendance • Mobility (number of transitions) • Difference from modal age in grade (indicator of retention) • Class size • The number of subject-relevant courses in which
the student is enrolled• Homogeneity of entering test scores in the class
DRE
FLDOE Value-Added Model Variables determining student learning growth
• Students with Disabilities (SWD) status – Language impaired– Hearing impaired– Visually impaired– Emotional/behavioral– Specific learning disability– Dual sensory impaired– Autism spectrum disorder– Traumatic brain injury– Other health impaired– Intellectual disability
• English Language Learner (ELL) status – LY
DRE
FLDOE Value-Added Model
Variables determining student learning growth
TERMS
DRE
The difference between Current test score and Predicted test score
What is the Predicted Student Score?
What is the Student Learning Growth Score?
DRE
What is the Predicted Student Score?
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
85
75
65
55
45
35
25
DRE
What is the Predicted Student Score?
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
PREDICTED SCORE55
The prediction describes typical growth observed among similar students.
Answer:Average of the current
scores of similar students85
75
65
45
35
25
55
DRE
Student Learning Growth is the Amount Above or Below Predicted Score
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
PREDICTED SCORE
Above Predicted Score
Below Predicted Score
ACTUAL SCORE
ACTUAL SCORE
10 20 30 40 50 60 70 80 90 100…
Each prior year test score will
have a Predicted current year test
score.
PRIOR TEST
?
What is the Predicted Student Score Based on Prior Achievement?
5060
70
FLDOE Value-Added Model
• Two or more years of prior achievement scores
• Attendance • Mobility (number of transitions) • Difference from modal age in
grade (indicator of retention) • Class size • The number of subject-relevant
courses in which the student is enrolled
• Homogeneity of entering test scores in the class
• LY
• Gifted status • Language impaired• Hearing impaired• Visually impaired• Emotional/behavioral• Specific learning disability• Dual sensory impaired• Autism spectrum disorder• Traumatic brain injury• Other health impaired• Intellectual disability
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
PRIOR TEST 10 20 30 40 50 60 70 80 90 100…
Based on Prior Achievement Only
Based on Prior Achievement & Other Variables
What is the Predicted Student Score?
Reading Grade 7Indicators By Degree of ImpactAll other variables being equal
Indicator DSS PointsELL Indicator 32Intellectual Disability -24
Reading Grade 7Indicators Ranked By Statistical Significance
Indicator T-StatisticAchievement: Prior Year 75.667Achievement: Two Prior Years 38.167Enrolled in 2 or more courses 18.354Difference from Modal Age 15.977Attendance 13.571Number of students in Class 1 8.439Homogeneity of Class 2 Prior Year Test Scores 7.182Language Impaired 5.362Specific Learning Disability 5.013Homogeneity of Class 1 Prior Year Test Scores 4.750ELL Indicator 4.673Homogeneity of Class 3 Prior Year Test Scores 3.188Number of students in Class 5 2.385Enrolled in 2 or more class periods 2.289Mobility: Number of School Transfers 2.271Intellectual Disability 2.141
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
DRE
What is the Predicted Student Score?
Calculating Learning Growth of Students
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
Student PY CY Pred Growth
A 20 30 40 -10
B 30 55 45 10
C 40 40 50 -10
D 50 70 60 10
DRE
Calculating Learning Growth of Students
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
Student PY CY Pred Growth
A 20 30 40 -10
B 30 55 45 10
C 40 40 50 -10
D 50 70 60 10
DRE
Calculating Learning Growth of Students
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
Student PY CY Pred Growth
A 20 30 40 -10
B 30 55 45 10
C 40 40 50 -10
D 50 70 60 10
DRE
Calculating Learning Growth of Students
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
Student PY CY Pred Growth
A 20 30 40 -10
B 30 55 45 10
C 40 40 50 -10
D 50 70 60 10
DRE
DRE
How do you calculate the teacher learning growth score?
• Identify the students assigned to the teacher
• Determine the learning growth of each of the assigned students
• Calculate the average learning growth of the students
TERMS
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
DRE
Student PY CY Pred Growth
A 20 30 40 -10
B 30 55 45 10
C 40 40 50 -10
D 50 70 60 10
Average 0
Ms. TypicalStudent Growth
Teacher Growth Score = Average Student Growth
Teacher Growth Score = Average Student Growth
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
Ms. Positive Student Growth
DRE
Student PY CY Pred Growth
A 20 30 40 - 10
B 30 55 45 10
C 40 75 50 25
D 50 70 60 10
Average 8.75
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
DRE
Student PY CY Pred Growth
A 20 30 40 -10
B 30 25 45 - 20
C 40 40 50 -10
D 50 70 60 10
Average - 7.5
Ms. Negative Student Growth
Teacher Growth Score = Average Student Growth
DRE
How do you calculate the school learning growth score?
• Identify the students assigned to the school
• Determine the learning growth of each of the assigned students
• Calculate the average learning growth of the students
School Growth Score = Average Student Growth
PRIOR TEST
10 20 30 40 50 60 70 80 90 100…
DRE
Stdt PY CY Pred Growth
G 10 65 35 30H 20 25 45 -20I 30 55 45 10J 40 40 50 -10K 50 55 55 0L 60 45 60 -15M 70 85 70 15N 80 45 75 -30O 90 80 100 -20Avg -4.44
How is the Teacher Value-Added Score Calculated?
DRE
FLDOE Teacher Value-Added ModelConceptual
School Growth
Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)
Teacher Growth
- .5 +( ) ( XSchool Growth
)=
DRE
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSS
PY Math CY Math
Predicted Growth
1717 1833 1844.89 -11.891764 1922 1876.31 45.691553 1793 1735.28 57.721683 1886 1822.17 63.83
Avg 38.84
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSTEACHER A
PY Math
CY Math
Predicted Growth
1506 1684 1703.86 -19.861997 2059 2032.04 26.961691 1857 1827.51 29.491153 1510 1467.92 42.082036 2108 2058.11 49.891876 2003 1951.17 51.83
Avg 30.06
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSTEACHER B
PY Math CY Math
Predicted Growth
1777 1865 1885.00 -20.00
1898 1954 1965.87 -11.87
1734 1894 1856.26 37.74
2001 2075 2034.72 40.28
1575 1805 1749.98 55.02Avg 20.24
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSTEACHER C
PY Math CY Math Predicted Growth
TEACHER A 1717 1833 1844.89 -11.89
1764 1922 1876.31 45.69
1553 1793 1735.28 57.72
1683 1886 1822.17 63.83
1506 1684 1703.86 -19.86
TEACHER B 1997 2059 2032.04 26.96
1691 1857 1827.51 29.49
1153 1510 1467.92 42.08
2036 2108 2058.11 49.89
1876 2003 1951.17 51.83
1777 1865 1885.00 -20.00TEACHER C 1898 1954 1965.87 -11.87
1734 1894 1856.26 37.74
2001 2075 2034.72 40.28
1575 1805 1749.98 55.02
SCHL AVG 29.13
Current Grade 7 FCAT Math DSS vs. Prior Grade 6 FCAT Math DSSSCHOOL
Teacher Value-Added Score
Teacher A
Teacher B
Teacher C
Teacher Growth 39 30 20
School Growth 29 29 29
TChgrowth - Schgrowth 10 1 -9.5 x Schgrowth 15 15 15Tchvas 25 16 6
DRE
Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)
DRE
Summary
• Based on prior achievement and selected student characteristics• Student Learning Growth–Difference between current score and
predicted score• Teacher VAM consider both teacher
and school learning growth
DRE
References
• FLDOE Student Growth Implementation Committeehttp://www.fldoe.org/committees/sg.asp
• FLDOE Race to the Top (RTTT)http://www.fldoe.org/arra/racetothetop.asp
• SDPBC Department of Research and Evaluationhttp://www.palmbeachschools.org/dre/Articles.asp