understanding parcc and other assessments...understanding parcc and other assessments wall township...
TRANSCRIPT
Understanding PARCC and other Assessments
Wall Township Public SchoolsNovember 17, 2015
This presentation will be updated as more information becomes available on Wall Township results from 2015. This presentation is current as of November 23, 2015.
Partnership for Assessment of Readiness for College and Careers (PARCC) PARCC is a multi-state consortium that allows states to
pool resources and expertise to develop a meaningful, comparable, high-quality assessment that can be used to guide efforts to continually improve the educational system by supporting teaching and learning, identifying struggling schools, informing teacher development, and providing parents with feedback on their own child’s strengths and challenges
Why did NJ change to the PARCC? Discrepancies emerged between student proficiency rates
as reported by NJ’s state tests and the National Assessment of Educational Progress (NAEP)
About 32% of NJ students entering 4-year colleges and 70% of first-time students entering 2-year colleges require one or more remedial classes before they can begin taking credit-bearing coursework
New Jersey’s tests, and the HSPA in particular, gave parents and educators a false sense of achievement
PARCC is aligned to the Common Core State Standards which were adopted by New Jersey
A Closer Look at the HSPA Problem
National Measures New Jersey Measures
In 2013, 41% of NJ’s 12th grade students met the NAEP definition of College and Career Readiness in reading
Of the graduating class of 2015 who took the SAT, 44% met the College Board’s benchmark of College and Career Readiness by achieving a composite score of 1550 across the three sections of the test
Of the graduating class of 2015 who took the ACT, 43% met the ACT’s benchmark of College and Career Readiness by meeting individual performance levels in four subject areas of the ACT
Over 90% of 11th grade students were proficient or advanced proficient on the 2014 HSPA in LAL
Approximately 80% of 11th grade students were proficient or advanced proficient on the 2014 HSPA in math
ACT, SAT and AP Results in Wall Township In 2014 78% of the students took the ACT or SAT 60% of the graduates in 2015 indicated that they would be
attending 4 year colleges, 27% indicated that they would be attending 2 year colleges (87% overall)
34% of the students in Wall met the ACT measure of college and career readiness
56% of the students who took the SAT scored 1550 or higher, an 10% increase in four years 2010-2011: 45.8% 2011-2012: 54.6% 2012-2013: 50.9% 2013-2014: 56.8% 2014-2015: 56.0%
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade 6th grade 7th grade 8th grade 11th grade
LANGUAGE ARTS 2014 NJASK AND HSPAWall New Jersey
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade 6th grade 7th grade 8th grade 9th grade 10th grade 11th grade
Language Arts 2015 PARCC NJ Results Wall Results
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade 6th grade 7th grade 8th grade 11th grade
MATHEMATICS 2014 NJASK AND HSPAWall New Jersey
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade 6th grade 7th grade 8th grade Algebra I Geometry Algebra II
Mathematics 2015 PARCC NJ Results Wall Results
NJASK Compared to NAEPNJ ASK Wall
2014NJ ASK NJ
2014NAEP (NJ)
2015
4th grade Reading 76.2 59.8 55
8th grade Reading 94.6 79.8 47
11th grade Reading 96.2 92.0 47
4th grade Math 94.0 74.9 56
8th grade Math 89.8 71 62
11th grade Math 84.3 80.0 37
Scores indicate the % of students meeting or exceeding expectations
PARCC and NAEP- National Snapshot
NAEP Results: New Jersey & the Nation4th grade
MathNew Jersey
AverageNationalAverage
NJ % proficientor above
Nation % proficient or
above
2015 245 240 56 46
2013 247 241 59 49
2011 248 240 61 46
2009 247 239 58 44
2007 249 239 61 44
2005 244 237 53 40
States that scored higher than New Jersey in 2015:1. Massachusetts (251 average)2. Minnesota (250 average) 3. New Hampshire (249 average)4. Indiana (248 average)5. Wyoming (247 average) 6. Virginia (247 average)
NAEP Results: New Jersey & the Nation8th grade
MathNew Jersey
AverageNationalAverage
NJ % proficientor above
Nation % proficient or
above
2015 293 281 62 40
2013 296 284 65 42
2011 294 283 61 42
2009 293 282 58 40
2007 289 280 50 38
2005 284 278 45 34
States that scored higher than New Jersey in 2015:1. Massachusetts (297 average)2. New Hampshire (294 average) 3. Minnesota (294 average)
NAEP Results: New Jersey & the Nation4th grade Reading
New JerseyAverage
NationalAverage
NJ % proficientor above
Nation % proficient or
above
2015 229 221 55 43
2013 229 221 54 42
2011 231 220 55 39
2009 229 220 50 39
2007 231 220 55 39
2005 223 217 47 37
States that scored higher than New Jersey in 2015:1. Massachusetts (235 average)2. New Hampshire (232 average) 3. Vermont (230 average)
NAEP Results: New Jersey & the Nation8th grade Reading
New JerseyAverage
NationalAverage
NJ % proficientor above
Nation % proficient or
above
2015 271 264 47 36
2013 276 266 53 38
2011 275 264 51 35
2009 273 262 47 32
2007 270 261 43 31
2005 269 260 42 32
States that scored higher than New Jersey in 2015:1. New Hampshire (275 average)2. Massachusetts (274 average) 3. Vermont (274 average)4. Connecticut (273)
Level 1: Not yet meeting grade-level expectations
Level 2: Partially meeting grade-level expectations
Level 3: Approaching grade-level expectations
Level 4: Meeting grade-level expectations
Level 5: Exceeding grade-level expectations
PARCC Performance levels
Count of Valid
TestScores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=
Level 4
Grade 3 193 3 10 19 59 9 68 44%Grade 4 230 3 4 19 53 21 74 51%Grade 5 215 3 5 23 59 11 70 52%Grade 6 239 5 11 29 47 9 56 49%Grade 7 220 5 11 20 44 20 64 52%Grade 8 220 9 10 20 42 20 62 52%Grade 9 191 10 20 24 34 12 46 40%Grade 10 142 32 18 23 20 8 28 37%Grade 11 59 20 24 20 32 3 35 41%
Wall Township’s 2015 PARCC GRADE-LEVEL OutcomesEnglish language arts/literacy
NJ PARCC 2015 and NJ NAEP 2015Language Arts/Reading
NationalPARCC Results
NJ PARCCResults
Wall PARCC Results
NJ NAEPResults
3rd grade 38% 44% 68%
4th grade 42% 51% 74% 55%
5th grade 40% 51% 70%
6th grade 39% 49% 55%
7th grade 42% 52% 64%
8th grade 42% 52% 62% 47%
9th grade 40% 39% 46%
10th grade 37% 36% 28%
11th grade 39% 41% 35% 47% (2013)
188 9th graders took the test- 63% of the grade level142 10th graders took the test- 48% of the grade level59 11th graders took the test- 18% of the grade level
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade 6th grade 7th grade 8th grade 9th grade 10th grade 11th grade
Language Arts
All PARCC States
NJ Results
Wall Results
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade
Language Arts by School
District
Allenwood
Central
Old Mill
West Belmar
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
Allenwood 54 4 7 20 54 15 68 44%Central 55 2 9 20 60 9 68 44%Old Mill 50 2 16 20 60 2 68 44%West Belmar
34 3 9 15 65 9 68 44%
Wall Township’s 2015 PARCC Third Grade Outcomes by SchoolEnglish language arts/literacy
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
Allenwood 51 2 8 18 39 33 74 51%Central 69 3 3 13 61 20 74 51%Old Mill 77 4 3 22 57 14 74 51%West Belmar
33 0 6 27 48 18 74 51%
Wall Township’s 2015 PARCC Fourth Grade Outcomes by School English language arts/literacy
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
Allenwood 47 6 0 23 62 9 70 51%Central 67 3 4 25 61 6 70 51%Old Mill 68 1 10 21 51 16 70 51%West Belmar
33 0 0 21 67 12 70 51%
Wall Township’s 2015 PARCC Fifth Grade Outcomes by SchoolEnglish language arts/literacy
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
6th grade 236 5 11 29 47 9 55 49%7th grade 216 5 11 20 44 20 64 52%8th grade 218 8 10 21 42 20 62 52%
Wall Township’s 2015 PARCC Intermediate Level Outcomes by GradeEnglish language arts/literacy
ALGEBRA I PARCC OUTCOMES AND COURSE GRADES
PARCC Algebra I (2015)
Percent “C” or higher in Algebra I course AY1415
Count % Meeting or Exceeding
Count* % >= C
Grade 6 66 92% 62 100%
Grade 7 3,536 93% 3,305 94%
Grade 8 27,498 72% 24,944 89%
Grade 9 53,656 18% 44,923 67%
Grade 10 5,542 4% 3,170 48%
Grade 11 1,398 4% 623 46%
* Based on an overall 84% match rate at a student-level between NJSMART course roster collection and PARCC Algebra I assessment data.
Looking for mismatches between outcomes and expectations is an important first step, i.e., roughly 18% of freshman met or exceeded expectations in PARCC Algebra I yet 67% received Cs or better in their course.
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=
Level 4
Grade 3 192 2 11 17 59 13 72 45%Grade 4 231 1 7 30 56 6 62 41%Grade 5 212 0 7 35 52 5 57 41%Grade 6 240 5 15 26 47 7 54 41%Grade 7 168 1 15 48 36 0 36 37%Grade 8* 89 22 22 29 26 0 26 24%Algebra I 206 8 14 23 54 1 55 36%Geometry 179 8 18 35 36 2 38 22%Algebra II 121 16 23 31 31 0 31 24%
Wall Township’s 2015 PARCC GRADE-LEVEL Outcomes Mathematics
NJ PARCC 2015 and NJ NAEP 2015Mathematics National
PARCC ResultsNJ PARCC
ResultsWall PARCC
ResultsNJ NAEPResults
3rd grade 38% 45% 64%
4th grade 32% 40% 62% 56%
5th grade 32% 41% 57%
6th grade 32% 41% 54%
7th grade 29% 37% 36%
8th grade 27% 24%* 26% 62%
Algebra I 31% 36% 55%
Geometry 27% 24% 38%
Algebra II 21% 23% 31%
*does not include the results for students in 8th grade who took Algebra I
116 8th graders and 49 7th graders were in Algebra (165 students), 133 took the test, 81% passed. 72 HS students took the Algebra I PARCC- 8% passed
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade 6th grade 7th grade 8th grade Algebra I Geometry Algebra II
Mathematics
All PARCC States
NJ Results
Wall Results
0
10
20
30
40
50
60
70
80
90
100
3rd grade 4th grade 5th grade
Mathematics by School
District
Allenwood
Central
Old Mill
West Belmar
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
Allenwood 54 2 9 17 59 13 64% 45%Central 54 4 6 31 48 11 64% 45%Old Mill 50 2 16 24 54 4 64% 45%West Belmar
34 0 15 21 53 12 64% 45%
Wall Township’s 2015 PARCC Third Grade Outcomes by SchoolMathematics
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
Allenwood 51 0 8 20 67 6 62% 40%Central 70 3 3 29 59 7 62% 40%Old Mill 77 0 8 26 53 3 62% 40%West Belmar
33 0 15 36 39 9 62% 40%
Wall Township’s 2015 PARCC Fourth Grade Outcomes by School Mathematics
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
Allenwood 47 0 9 23 62 6 57 41%Central 66 0 11 44 42 3 57 41%Old Mill 66 2 6 32 58 3 57 41%West Belmar
33 0 0 42 48 9 57 41%
Wall Township’s 2015 PARCC Fifth Grade Outcomes by SchoolMathematics
Count of
Valid Test
Scores
Not Yet Meeting(Level 1)
PartiallyMeeting(Level 2)
ApproachingExpectations
(Level 3)
MeetingExpectations
(Level 4)
ExceedingExpectation
(Level 5)
District % >=
Level 4
NJ % >=Level 4
6th grade 237 5 15 26 47 7 54% 41%7th grade 164 1 15 49 35 0 35% 37%8th grade 87 23 22 29 26 0 26% 24%Algebra I 133 0 1 18 79 2 81% 36%Geometry 51 2 0 27 65 6 71% 23%
Wall Township’s 2015 PARCC Intermediate Level Outcomes by GradeMathematics
Graduation Requirements-2016, 2017, 2018, and 2019 English Language Arts MathematicsPARCC ELA Grade 9 >=750 (Level 4) or PARCC Algebra I>=750 (Level 4) or
PARCC ELA Grade 10 >=750 (Level 4) or PARCC Geometry >=725 (Level 3) or
PARCC ELA Grade 11 >=725 (Level 3) or PARCC Algebra II >=725 (Level 3) or
SAT Reading* >=400 or SAT Math* >=400 or
ACT Reading or ACT PLAN Reading >=16 or ACT or ACT PLAN >=16 or
Accuplacer Write Placer >=6 or Accuplacer Elementary Algebra >=76 or
PSAT 10 Reading or PSAT-NMSQT Reading ** >= 40 or
PSAT 10 Math or PSAT-NMSQT Math** >=40 or
ACT Aspire Reading >=422 or ACT Aspire Math >=422 or
ASVAB-AFQT Composite >=31 or ASVAB-AFQT Composite >=31 or
Meet the Criteria of the NJDOE Portfolio Appeal
Meet the Criteria of the NJDOE Portfolio Appeal
*SAT taken prior to March 2016 **PSAT taken prior to October 2015. The College Board will establish new “cut scores” in December 2015 for the new PSAT and in May 2016 for the new SAT
Reading and College and Career Readiness Reading Environment Lexile Range of Texts
High School Literature 750-950
College Literature 810-1050
High School Textbooks 950-1150
College Textbooks 1100-1300
Military 1150-1250
Personal Use* 1150-1350
Entry Level Occupations 1180-1380
SAT, ACT and AP tests 1100-1200
*Personal use includes newspapers, Internet sites, job applications, contracts, mortgages, manuals, loan applications, etc.
What about PISA? Programme for International Student Assessment (PISA) is a triennial
international survey which aims to evaluate educational systems worldwide by testing the skills and knowledge of 15-year old students
Since the year 2000, every three years, fifteen-year-old students from randomly selected schools worldwide take tests in the key subjects: reading, mathematics and science, with a focus on one subject in each year of assessment. In 2012, some economies also participated in the optional assessments of Problem Solving and Financial Literacy.
Students take a test that lasts 2 hours. The tests are a mixture of open-ended and multiple-choice questions that are organized in groups based on a passage setting out a real-life situation. A total of about 390 minutes of test items are covered. Students take different combinations of different tests.
70 countries/economies participated in the 2012 PISA. Approximately the same # are expected to participate in 2015.
US Performance on the PISA- 2012 Mathematics Below average- ranked 27th (Mean score was 481)
Mean score was 494 overall Top performer (China) mean score was 613
Comparable with Hungary, Italy, Lithuania, Norway, Portugal, the Russian Federation, the Slovak Republic, Spain and Sweden.
25% of the US students did not reach baseline Level 2 on the PISA US students show particular weaknesses in performing mathematics
tasks with higher cognitive demands, such as taking real-world situations, translating them into mathematical terms, and interpreting mathematical aspects in real-world problems
An alignment study between the Common Core State Standards for Mathematics and PISA suggests that a successful implementation of the Common Core Standards would yield significant performance gains also in PISA.
US Performance on the PISA- 2012 Reading Average-ranked 17th (Mean score was 498)
Mean score was 496 overall Top performer (China) mean score was 570
Comparable with Austria, the Czech Republic, Denmark, France, Hungary, Israel, Italy, Norway, Portugal, the United Kingdom and Viet Nam.
14 Top Performing Countries on PISAMathematics Mean Reading Mean Science Mean
Shanghai China 618 570 580
Singapore 573 542 551
Hong Kong-China 561 545 555
Chinese Taipei 560 523 523
Korea 554 536 538
Macao-China 538 509 521
Japan 536 538 547
Liechtenstein 535 515 525
Switzerland 531 509 515
Netherlands 523 511 522
Estonia 521 516 541
Finland 519 524 545
Canada 518 523 525
Poland 518 518 526
PISA Observations Socio-economic disadvantage has a notable impact on student performance
in the United States: 15% of the variation in student performance in the United States is explained by students’ socio-economic status. In other words, in the United States, two students from a different socio-economic background vary much more in their learning outcomes than is normally the case in these other countries/economies.
Disadvantaged students show less engagement, drive, motivation and self-beliefs than advantaged students.
Punctuality and attendance at school have strong associations with performance across all countries. Some 30% of 15-year-old students in the United States reported that they had arrived late for school at least once in the two weeks prior to the PISA test, slightly below the OECD average of 35%, and some 20% of students in the United States reported that they had skipped a day of school in the previous two weeks, above the OECD average of 15%. Those who had skipped a class or a day of school scored 24 points lower in mathematics, on average, than those who hadn’t.
Data Sources NJDOE resources: http://www.nj.gov/education/assessment/ National Center for Education Statistics:
https://nces.ed.gov/nationsreportcard/reading/stateassessment.aspx
Organisation for Economic Co-operation and Development (OECD): http://www.oecd.org/pisa/keyfindings/PISA-2012-results-US.pdf
Mathematica Policy Research: http://www.mathematica-mpr.com/our-publications-and-findings/publications/in-focus-for-massachusetts-students-parcc-and-mcas-exams-comparable-in-predicting-college-outcomes