necap results and accountability a presentation to superintendents march 22, 2006
TRANSCRIPT
NECAP Results and Accountability
A Presentation to Superintendents
March 22, 2006
Standard Setting NECAP is criterion-referenced not norm-
referenced All three states agreed to use the same
standards About 84 teachers from RI were part of
the standard setting process All teachers in grades 3-8 had the
opportunity to be part of the standard setting process
Keep in mind…
NECAP and NSRE are not equated
It’s not useful or accurate to say we’re doing better or worse than on the NSRE
This is the beginning of a new trend line
Also keep in mind… The results are comparable, that is,
we’re seeing similar patterns of results
We have not lowered our expectations for students
NECAP Achievement Levels Descriptions
Proficient with Distinction: Students performing at this level demonstrate the prerequisite knowledge and skills needed to participate and excel in instructional activities aligned with the GLEs at the current grade level. Errors made by these students are few and minor and do not reflect gaps in prerequisite knowledge and skills
NECAP Achievement Level Descriptions
Proficient: Students performing at this level demonstrate minor gaps in the prerequisite knowledge and skills needed to participate and perform successfully in instructional activities aligned with the GLE at the current grade level. It is likely that any gaps in prerequisite knowledge and skills demonstrated by these students can be addressed during the course of typical classroom instruction.
NECAP Achievement Level Descriptions
Partially Proficient: Students performing at this level demonstrate gaps in prerequisite knowledge and skills needed to participate and perform successfully in instructional activities aligned with the GLE at the current grade level. Additional instructional support may be necessary for these students to meet grade level expectations.
NECAP Achievement Level Descriptions
Substantially Below Proficient: Students performing at this level demonstrate extensive and significant gaps in prerequisite knowledge and skills needed to participate and perform successfully in instructional activities aligned with the GLE at the current grade level. Additional instructional support is necessary for these students to meet grade level expectations.
State Results- Reading
Grade PWD P PP SBP
3 13% 47% 24% 16%
4 13 47 22 17
5 13 47 25 16
6 11 47 27 15
7 10 46 26 17
8 10 45 27 17
State Results- Writing
Grade PWD P PP SBP
5 12% 43% 30% 15%
8 6 42 33 18
State Results- Mathematics
Grade PWD P PP SBP
3 12% 39% 25% 25%
4 12 40 23 25
5 11 41 22 25
6 10 39 23 28
7 10 37 22 31
8 11 37 21 32
State Results: Placing Results in Context for 4th Grade
Percent at or above Proficient
NECAP (05) NSRE (04) NAEP* (05)
Reading 60% 67.2% 62% (30%)
Math 62% 51.3% 76% (31%)
* Percent at or above Basic and at or above Proficient
State Results: Placing Results in Context for 8th Grade
Percent at or above Proficient
NECAP (05) NSRE (04) NAEP* (05)
Reading 55% 44.9% 71% (31%)
Math 48% 39.3% 63% (24%)
* Percent at or above Basic and at or above Proficient
Communicating results Provides us with a snapshot of our
school’s (district’s) achievement against the GLEs
Begins a new trend line for all of us Able to look at grade-by-grade
achievement Assists with ongoing instructional
and curriculum efforts
Communicating results Expect to have fewer wide
fluctuations in results due to changes in test forms
RI’s Accountability System
Proposed Revisions in Support of the
NECAP Tests
Working assumptions
Keep as much as possible from the old system
Adjust when necessary Adjust when new flexibilities
emerge that benefit schools and districts
Annual Measurable Objectives (AMOs)
We are able to keep the same AMOsLanguage Arts Mathematics
Elementary 80.1 68.1
Middle 73.3 55.1
AMOs continued This is the year that the AMOs
“jumped” to the next level For example, the Elementary
Reading AMO went from 76.1 to 80.1 This change had an impact on high
schools even without a change in assessments
Index Scale
Proficient with Distinction 100
Proficient 100
Partially Proficient 75
Substantially Below Proficient 50
25
Attribution NECAP tests measure the learning that
occurred in the prior school year. Therefore, scores will be attributed back to the school where the teaching took place.
Participation rates, however, will be based on where the testing occurred.
Index scores will be based on the 95% of students who took the test. Zeros will not be added to schools scores.
Cell Size and Error Bands
Cell size is 45 for all subgroups and at the school/district levels
Error Bands
Safe Harbor for this year Impossible to calculate because the NSREs and NECAP are
not equated; the scores are not comparable Appeal Process: Two-step process centered around the
reduction in the gap between the school’s index score and the state’s index score on the NSREs and the NECAP Step 1: Reductions in index scores will be compared
separately for the two tests (for the school level and/or subgroup level)
• 2004 NSRE school to 2004 NSRE state compared to 2005 NECAP school to 2005 NECAP state
Step 2: Reductions in the percentage of students below Proficient (Partially Proficient and Significantly Below Proficient)
One or the other
Safe Harbor, continued Schools must have more than 45 students in both the
NSRE and the NECAP groups before a comparison can be made.
This could result in a change in the school’s classification
Considerations for principals Ensure that student reports get home to families Host a “School Report Night” for families and the
community Think about how to build teacher capacity to use
assessment results Make everyone aware of support materials Work with School Improvement Teams to use
results Take advantage of the test interpretation
workshops
Grades Assessed About 72,000 Rhode Island students in
grades three through eight took the exam Mathematics: Grades 3,4,5,6,7,8 Reading: Grades 3,4,5,6,7,8 Writing: Grades 5,8
216,000 students in all three states
Test Interpretation Workshops March 27th Marriott 1:00 – 4:30 March 28th Marriott 8:30 – 12:00 April 5th Radisson 8:30 – 12:00 April 6th Radisson 1:00 – 4:30 April 7th Best Western 8:30 – 12:00
WHO?• Curriculum Directors, Principals• Lead Teachers, Coaches (substitutes will NOT be
reimbursed)• Register online at: iregister.measuredprogress.org
Full Academic Year
Def.: Students enrolled October 1 of the previous school year
For testing: Regardless of length of time enrolled in
school, all students must take the NECAP test. Students will be included in all assessment
results.For accountability:
Students will be removed from accountability calculations.
Communicating Results
NECAP is directly aligned to RI’s Grade Level Expectations
This assessment is designed to be sensitive to instructional changes
This is the first time that we have information that looks at grade-to-grade achievement (3 – 8)
Communicating Results (continued)
Districts are in the process of aligning the curriculum and instructional practices to reflect the GLEs
Score reports are designed to provide much more information to support school improvement and foster conversations between families and teachers
Analyses: “How are we able to support students’ learning with respect to the GLEs” not “Are we doing better or worse than we did on the NSRE?”
Using Results- Some Basics Scale Scores: Every grade level is
reported as 3 numbers The first number is always the grade
level that was assessed The final two numbers reflect the
scale- 00 – 80 40 is always proficient