ohio’s new accountability system ohio’s response to no child left behind (nclb) a.k.a....
TRANSCRIPT
Ohio’s New Accountability System
Ohio’s Response to No Child Left Behind (NCLB)
a.k.a. Elementary & Secondary Education Act
a.k.a. ESEA
January 8, 2002
2
Challenges• Tougher system• New ground-rules
– All students accounted for– Group, as well as aggregate,
performance counts
• Creates new starting point for judging future performance– 2002-03 results are not directly
comparable to past years
3
Opportunities• Multiple ways to tell the achievement
story• Highlights the achievement of all
students• Ohio’s educators have been
improving achievement for almost a decade -- we believe that 2003-04 and beyond will result in continuing improvement
4
Key Features
• Grades 3-8 reading & math tests
• Multiple measures
• School building designations
• Group accountability
• Recognition & consequences
• More timely results
5
Tests Administered
Previously• Grades 4, 6, 9• 5 subjects
ReadingMathematicsWritingScienceCitizenship
Now• Grades 3-8, 10• 5 subjects
ReadingMathematicsWritingScienceSocial studies
Ohio Test Schedule2003-04 2004-05 2005-06 2006-07 2007-08
GradesK-2
DiagnosticsR, W, M
DiagnosticsR, W, M
DiagnosticsR, W, M
DiagnosticsR, W, M
DiagnosticsR, W, M
Grade 3Achievement
R
DiagnosticsW
AchievementR, M
DiagnosticsW
AchievementR, M
DiagnosticsW
AchievementR, M
DiagnosticsW
AchievementR, M
DiagnosticsW, S, SS
Grade 4ProficiencyR, W, M, S, C
AchievementR, W
ProficiencyM, S, C
AchievementR, M, W
AchievementR, M, W
AchievementR, M, W
DiagnosticsS, SS
Grade 5Achievement
RAchievement
R, MAchievement
R, M, S, SSAchievement
R, M, S, SS
DiagnosticsW
Grade 6 ProficiencyR, W, M, S, C
ProficiencyR, W, M, S, C
AchievementR, M
AchievementR, M
AchievementR, M
DiagnosticsW, S, SS
Grade 7Achievement
MAchievement
R, MAchievement
R, M, WAchievement
R, M, W
DiagnosticsS, SS
Grade 8
AchievementR, M
AchievementR, M
AchievementR, M, S
AchievementR, M, S, SS
DiagnosticsW
Grade 10ProficiencyR, W, M, S, C
OGTR, M
OGTR, M, W, S , SS
OGTR, M, W, S , SS
OGTR, M, W, S , SS
OGTR, M, W, S , SS
7
Test Performance Levels
Proficiency Tests• Advanced• Proficient• Basic• Below Basic
Achievement Tests• Advanced• Accelerated• Proficient• Basic• Limited
8
Diagnostics• ODE-developed diagnostics required for:
– Students in buildings missing AYP for 2 years or more
– Transfer students– All Kindergarten students within first 6 weeks
• If school met AYP or missed for one year, district may select diagnostic
• 9th graders in AE & AW districts (10th grade practice test)
9
Student Intervention• Required for:
– 3rd graders reading below “proficient” -- intense remediation
– Students scoring below “proficient” on achievement tests
– Students failing to make satisfactory progress toward attaining grade level academic standards on diagnostic tests
– 9th graders scoring below “proficient” on the 10th grade practice test
10
Designations Applied
Previously• Districts only
Now• Districts• School buildings• Community
schools
11
Same Five Designations for Ohio
• Excellent
• Effective
• Continuous Improvement
• Academic Watch
• Academic Emergency
12
Designations Determined
Previously• Percent of
performance (local report card) indicators met
Now• Percent of
performance indicators
• Performance index score
• Improvement• AYP
13
Multiple Measures to Determine Designations
• Current Ohio Indicators (existing)
• Performance Index (new)
• Growth Calculation (new)
• Adequate Yearly Progress (federal requirement)
14
Multiple Measures:Current Ohio Indicators
• 22 total– 20 test scores
• 5 subjects• 4 grades (4th, 6th, 9th, 10th)
– graduation rate– attendance rate
• High standard -- 75% plus
15
Multiple Measures to Determine Designations
• Current Ohio Indicators (existing)
• Performance Index (new)
• Growth Calculation (new)
• Adequate Yearly Progress (federal requirement)
16
Multiple Measures: Ohio Performance Index
• More sensitive to gradations of achievement than indicators
• Credits achievement at all performance levels
• Weights higher performance more than lower performance
• Rewards “advanced” performance
17
Multiple Measures: Ohio Performance Index
Advanced 1.2Proficient 1.0Basic 0.6Below Basic 0.3Untested 0.0
18
Multiple Measures: Ohio Performance IndexPerf. Level % Weight ScoreAdvanced 2.0 1.2 2.4Proficient 21.6 1.0 21.6Basic 33.3 0.6 20.0Below Basic 39.2 0.3 11.8Untested 3.9 0.0 0
Total 100 55.8
19
Multiple Measures: Performance Index
N % weight score N % weight score N % weight scoreadvanced 2 2.0% 1.2 2.4 3 2.9% 1.2 3.5 5 4.9% 1.2 5.8proficient 22 21.6% 1.0 21.6 25 24.0% 1.0 24.0 28 27.2% 1.0 27.2basic 34 33.3% 0.6 20.0 41 39.4% 0.6 23.7 40 38.8% 0.6 23.3below basic 40 39.2% 0.3 11.8 32 30.8% 0.3 9.2 26 25.2% 0.3 7.6untested 4 3.9% 0.0 0.0 3 2.9% 0.0 0.0 4 3.9% 0.0 0.0total 102 55.8 104 60.4 103 63.9
2001-02 2002-03 2003-04
20
Multiple Measures: Ohio Performance Index
60.4
55.8
63.9
0
20
40
60
80
100
120
2001-02 2002-03 2003-04
21
Multiple Measures to Determine Designations
• Current Ohio Indicators (existing)
• Performance Index (new)
• Growth Calculation (new)
• Adequate Yearly Progress (federal requirement)
22
Multiple Measures:Growth Calculation --Value Added
• Based on individual student gain– once grades 3-8 tests in place– multiple years of data
23
Multiple Measures:Growth Calculation --Temporary Measure
• Based on improvement in performance index score– two years of improvement– at least 10 total points– at least 3 points in most recent
year
24
Multiple Measures:Growth Calculation --Temporary Measure
• District or school can move from:– Academic Emergency to Academic
Watch– Academic Watch to Continuous
Improvement
25
Multiple Measures to Determine Designations
• Current Ohio Indicators (existing)
• Performance Index (new)
• Growth Calculation (new)
• Adequate Yearly Progress (federal requirement)
26
AYP Applies to:
Previously• Title I funded
schools & districts only
Now• All public
schools & districts, including community schools
• Regardless of Title I funding
27
Group Accountability
Previously• Reported only
Now• Reported• Basis of federal
Adequate Yearly Progress calculation
28
Multiple Measures: NCLB Adequate Yearly Progress
• Whole school (all students)• Groups
– Race/ethnicity– Students with disabilities– Limited English proficient– Economically disadvantaged
29
Multiple Measures: Adequate Yearly Progress
• Same targets for each district, building, group, & statewide– Separate targets for % proficient:
• reading• mathematics
– 95% participation requirement
• High school graduation rate• K-8 attendance rate
30
Multiple Measures: Adequate Yearly Progress (2002-03 targets) Reading Math
Grade 4 40.5% 35.9%
Grade 6 36.0% 36.8%
Grade 9 78.0% 53.1%
31
Multiple Measures: Adequate Yearly Progress (trajectory based on 40% starting point)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Series1 40% 40% 50% 50% 50% 60% 60% 60% 70% 80% 90% 100%
2002-03 2003-04 2004-05 2005-06 2006-07 2007-08 2008-09 2009-10 2010-11 2011-12 2012-13 2013-14
32
Who Counts
Previously• Districts could
exclude:Students with
disabilitiesLimited English
proficient
Now• All students• No exclusions• Full academic
year• New rules for
where students count
33
New Report Card Criteria:Multiple Ways of Earning Designations
94% to 100%(21 or 22 for districts)
94% to 100%(21 or 22 for districts)
75% to 93%(17 to 20 for districts)
75% to 100%(17 to 22 for districts)
0% to 74%(0 to 16 for districts)
50% to 74%(11 to 16 for districts)
31% to 49%(7 to 10 for districts)
0% to 31%(0 to 6 for districts)
Temporary Growth Calculation ** --
Districts and schools will move from Emergency to Watch or from Watch to
Improvement if: (a) improved performance index score each of past two years, (b) total two-year gain of at least 10 points, and (c) most recent year's gain of at least
3 points.
and
Academic Watch
Academic Emergency and
Effective
or
or
or
or
or
or
Federal AYP Requirements
Value Added -- Once grades 3 to 8 reading and
math assessments are implemented and multiple
years of data available, Ohio will incorporate a measure of individual student grade-to-grade achievement gains
to help determine school building and district
designations.
Performance Index Score Growth Calculation
100 to 120
0 to 69
100 to 120
90 to 99
90 to 120
and
and
and
and
Missed AYP*
Met AYP
Missed AYP*
Met AYP
80 to 89
70 to 79
0 to 89Continuous
Improvement
or
Missed AYP
Missed AYP
Missed AYP
and
and
and
Met AYPandor
Excellent
Existing Ohio Report Card
Indicators
34
2002-03 Report Card Content
Previously• Percent of
performance (local report card) indicators met
• Designation
Now• Percent of
performance indicators
• Performance index score
• Improvement• AYP• Designation
35
Timeline for Report Card Release
Previously• February of next
school year
Now• Before start of
next school year
36
Recognition & Consequences
Recognition• Excellent• Effective
Consequences• Continuous
Improvement• Academic
Watch• Academic
Emergency
37
Consequences
School Buildings• School district
has primary responsibility for support, intervention, & consequences
Districts• State has
primary
responsibility for support, intervention, & consequences
38
Consequences
1 Year 2 Years 3 Years 4 Years 5 YearsEffectiveContinuous ImprovementAcademic WatchAcademic Emergency
Failing to Meet AYP
More Intrusiv
e
39
Consequences:Title I Funded Schools Only
• Choice (after missing AYP for two years)
• Supplemental services (after missing AYP for three years)
40
Consequences: All Schools
Less Intrusive• New curriculum• Decrease
management authority
• Appoint outside expert
• Extend day or year
More Intrusive• Replace key staff• Reorganize
administrative structure
after 4 years missing AYP
41
Consequences: All Schoolsafter 6 years missing AYP
• Reopen as community school• Replace personnel• Contract w/ nonprofit or for-profit entity to
operate school• Turn operation of building over to ODE• Other significant restructuring of
building’s governance
42
Consequences: All Districts
Less Intrusive• Withhold Title I
funds• New curriculum• Alternate
governance for particular schools
More Intrusive• Replace key staff• Appoint trustee in
place of superintendent & school board
after 4 years missing AYP
43
Challenges• Tougher system• New ground-rules
– All students accounted for– Group, as well as aggregate,
performance counts
• Creates new starting point for judging future performance– 2002-03 results are not directly
comparable to past years
44
Opportunities• Multiple ways to tell the achievement
story• Highlights the achievement of all
students• Ohio’s educators have been
improving achievement for almost a decade -- we believe that 2003-04 and beyond will result in continuing improvement
Accountability Website
www.ode.state.oh.us/Accountability/default.asp