NEW MEXICO STANDARDS BASED ASSESSMENT
2011 RESULTS
A Report Providing Comparisons to New Mexico
and District Trends
Prepared by Christoph Brunder August2011
2
STANDARDS BASED ASSESSMENT New Mexico, like all other states, under NCLB guidelines must develop content standards in reading/language arts, math and science. The state education agency must then develop a standards based assessment designed to measure all of the standards outlined in the content standards and benchmarks. This requirement establishes a criteria for proficiency at each grade in which the assessment is administered. This proficiency standard is not comparable to other states which have established their own standards, benchmarks and proficiency standards. New Mexico has had the current standards assessment in place for the last seven years. The assessment is administered to all students in NM public schools in grades 3 through 8. In 2008 the 9th grade test was discontinued by the PED and at the high school level only the 11th graders participated in the standards assessments. In school years 2005 and 2006 this test was administered to 9th graders. In 2007 the test was administered to 9th and 11th graders. There are several changes to the 2011 administration. The construct of the test was changed so that multiple choice questions now make up 80% of the test rather than 70% and the open ended response items are 20% of the test rather than 30%. Multiple choice answers account for approximately 62% of the test, depending on the grade level. The second change was the vertical alignment of the scale scores. The new scale range from 0 to 80 and a score of 40 representing proficient performance allows comparison of student progress from grade to grade. Finally, the performance standards for reading and science were increased to remain consistent with high standards in other content areas and to improve alignment between SBA and NAEP standards. Therefore, uses this past administration’s results as a new baseline. Students who are not proficient in English, who are proficient in Spanish and who have been enrolled in US education systems for 3 or fewer years may participate in standards assessments in Spanish. Special education students whose educational program addresses alternative standards to the content standards may participate in the NM Alternate Assessment. This assessment is not comparable to the SBA and the results are reported separately. The results presented in this report are the foundation for the state ratings of schools for Adequately Yearly Progress. However, these results include ALL students tested during the testing window who participated in the standard assessment. For AYP purposes, this data set will be modified to exclude any students who do not meet the full academic year standard, the alternate assessment results will be added and a confidence interval will be applied. Therefore, the reader is cautioned not to use these data to estimate the AYP status of the district or a particular school. This report provides a quick overview of APS overall performance in reading and math, a comparison between APS and the state, a look at the trend over the past seven years.
3
District Goals
4
District SBA Reading Targets and Actual Scores
5348
5446 47
55 565651
5749 50
58 595954
6052 53
61 626257
6355 56
64 65
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade
% P
rofic
ient
and
Adv
ance
d
2011 Actual 2012Target 2013Target 2014 Target
• APS established new baselines due to the increase in performance standards • The overall goal for the district is a continuous 3% growth
5
District SBA Math Targets and Actual Scores
52 48 4437 40 44 44
55 51 4740 43 47 47
58 5450
43 46 50 50
61 57 5346 49 53 53
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade
% P
rofic
ient
and
Adv
ance
d
2011 Actual 2012Target 2013 Target 2014 Target
• Identical 3% improvement targets are set for math
6
2011 Scores Compared to Recalibrated 2008, 2009 and
2010 Scores
7
• Because of the change in cut scores the 2011 scores can only be compared by recalibrating the older data to the revised scale
• In the primary grades we can see an upward trend in reading and math • The largest gains over the past four years are in grades 4 and 5 math
8
• In secondary grades the trends are positive in math and mixed in reading • All grade levels showed improvement in math with the largest gains in grade 7 • Grades 7 and 11 improved reading scores over the past four years
9
District Reading and Math Scores
10
English SBA Reading and Math 2010 - 2011
54 49 5546 48
55 5653 49 43 37 3744 44
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade% P
rofic
ient
and
Adv
ance
d
Reading Math
• Starting at grade 5 APS students scored substantially higher in reading than they did in math • Students in grade 3 had the highest percent proficient in math of any grades • In grades 5, 7, 8 and 11 students scored over 10% higher in reading than in math
11
Spanish SBA Reading and Math 2010 - 2011
3421 27
11 13
3216
3423 21
3 722
9
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade% P
rofic
ient
and
Adv
ance
d
Reading Math
• In Spanish we can see the same pattern as in English. • Grade 5 is the only grade in which math scores are higher than reading scores • The differences between reading and math proficiency are largest in the middle and high school
12
Comparison: APS – State for Reading, Math and Science
13
2010 - 2011 APS - State Reading Comparison English
54 49 5546 48
55 565447 53 48 48 53 48
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade% P
rofic
ient
and
Adv
ance
d
APS State
• APS outperforms the state in 4 of the 7 grade levels in English reading • In grades 3 and 7 APS and the rest of the state have the exact same scores • The largest difference is in grade 11 where APS students scored 8 percentage points higher
14
2010 - 2011 APS - State Reading Comparison Spanish
3421 27
11 13
3216
3723 29 25 20
2918
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade% P
rofic
ient
and
Adv
ance
d
APS State
• In Spanish reading APS scored higher than the rest of the State only in grade 8
15
2010 - 2011 APS - State Math Comparison English
53 49 4537 40 44 44
5346 43 37 37 41 38
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade% P
rofic
ient
and
Adv
ance
d
APS State
• In the English version of the math SBA, APS outperforms the rest of the State in 5 of the 7 grade levels and has the same percent proficient in the remaining two.
• As in reading, the most significant difference again can be seen in grade 11 where APS students scored 6 percentage points higher than the rest of the students in the State
• Scores for both APS and the State drop from grades 3 – 6 but we can see an increase in grades 7 - 11
16
2010 - 2011 APS - State Math Comparison Spanish
3423 21
3 722
9
3320 15 9 14 16 10
0
20
40
60
80
100
3rd Grade 4th Grade 5th Grade 6th Grade 7th Grade 8th Grade 11th Grade% P
rofic
ient
and
Adv
ance
d
APS State
• On the Spanish math assessment APS out-performed the State in grades 3 – 5 and 8 • Overall, the Spanish math scores are significantly lower than the English math scores • There is a continuous drop in the performance levels from grade 3 - 7
17
• Science was only administered for grades 4, 7, and 11 this year • APS scored higher than the rest of the State in all 3 grade levels
18
• In the Spanish version of the science test one can observe much lower overall scores for APS and State than in English
19
Performance by Ethnic Groups
20
2010 - 2011 Reading Performance by Ethnicity
34 38 3929
3950
69 66 66 65 6372
47 4551
41 44 444841
4940 41
48
72 69 7465 70 73
0
20
40
60
80
100
3rd 4th 5th 6th 7th 8th 11th
% P
rofic
ient
American Indian Asian Black Hispanic White
• There is a significant achievement gap among ethnic groups with Caucasian and Asian students outperforming American
Indians, Blacks and Hispanics. • Caucasian students perform higher than Asian students in all grade levels except grade 6 where the proficiency levels are
identical • Hispanic and Black students outperform American Indian Students in all grade levels except in grade 8
21
2010 - 2011 Math Performance by Ethnicity
34 3832
2634
27
71 7064 66 68 71
38 35 3625 29
3547 43 38
30 33 35
73 68 6558 59
65
0
20
40
60
80
100
3rd 4th 5th 6th 7th 8th 11th
% P
rofic
ient
American Indian Asian Black Hispanic White
• In math, the gap between Asian and Caucasian students compared to American Indians, Blacks, and Hispanics is larger across all grade levels than it is in reading.
• Asian students score significantly higher than Caucasian students in grades 7 and 8. • Hispanics scored higher than Blacks and American Indians in all but one grade
22
AYP Subgroups Compared to All Students
23
2010 - 2011 Primary Grades by Subgroup
13 2011 13 14 12
44 43 38 39 4434
22 2613 19 16 14
54 53 49 49 5545
020406080
100
Read Math Read Math Read Math
Grade 3 Grade 4 Grade 5
% P
rofic
ient
SPED FRPL ELL ALL
• Among the three special groups, special education students and English language learners perform much lower in reading and math than economically disadvantaged students
24
2010 - 2011 Secondary Grades by Subgroup
8 6 7 5 12 5 10 6
34 37 4226 30
42 3824
7 12 15 8 10 10 8 11
4637
4840
5544
5644
020406080
100
Read Math Read Math Read Math Read Math
Grade 6 Grade 7 Grade 8 Grade 11
% P
rofic
ient
SPED FRPL ELL ALL
• Similar patterns can be observed in secondary grades except that the overall gap between the special education and ELL
students and the overall student performance is larger than in primary grades. • Students receiving special education services in high school are usually more severely disabled than students in lower grade
and have a greater gap between their learning and that of their peers. • Also, it is common that secondary ELL students have less educational experiences in their native country and are therefore less
proficient in academic English