a professional development seminar presented by: michele mailhot and susan smith march 21, 2012...
TRANSCRIPT
A professional development seminar presented by:
Michele Mailhot and Susan Smith March 21, 2012
[email protected]@maine.gov
NECAP Mathematics Assessment
Goals of the presentation:
1. communicate NECAP mathematics test design, structure and scoring procedures;
2. demonstrate how to access NECAP mathematics data;
3. provide strategies for using NECAP data to inform instruction and program analysis, and;
4. describe the influence that the Common Core State Standards will have on future mathematics assessment.
Purpose and Design of the NECAP Mathematics Assessment
Measures the mathematics content of the NECAP Grade Level Expectations (GLEs)
Reports across four subtopics
Provides a consistent measure of mathematics programs across all schools in the state
Purpose and Design of the NECAP Mathematics Assessment
3 separate sections requiring a minimum of 45 minutes of testing time each; 1 session does not permit the use of calculator or other tools
48 questions worth 66 common score points – 32 multiple choice questions, 12 short answer questions (worth 1 or 2 points), and 4 constructed response questions (worth 4 points)
Purpose and Design of the NECAP Mathematics Assessment
The raw score is calculated in the following manner:
1 point for each correct answer to MC items
1 point for each correct answer to 1-pt SA items
0-2 points for each answer to 2-pt SA items, with a score of 2 indicating that the response is complete.
0 – 4 points for each answer to constructed response items, with a score of 4 indicating that the response is complete.
Purpose and Design of the NECAP Mathematics Assessment
Distribution of Emphasis for Mathematics
Mathematics Content Standards (GLEs)
Grade 2(3)*
Grade3(4)
Grade 4(5)
Grade 5(6)
Grade 6(7)
Grade 7(8)
Numbers and Operations
55% 50% 45% 40% 30% 20%
Geometry and Measurement
15% 20% 20% 25% 25% 25%
Functions and Algebra
15% 15% 20% 20% 30% 40%
Data, Statistics and Probability
15% 15% 15% 15% 15% 15%
* 2(3) indicates end-of-grade 2 GLEs are tested at the beginning of grade 3
NECAP Mathematics Assessment
Overview of the data analysis tool (a product of Measured Progress)
Using this tool, school designated personnel can view student’s responses to MC answers and earned points for SAs and CRs for every released NECAP mathematics item.
iServices – “Interactive” Tab
Released Items Summary Data
Multiple Choice Item
Short Answer and Constructed Response – including scoring guide, sample student response and annotation
Item Analysis Reports
Longitudinal Data
School Reports
NECAP Mathematics Assessment - Data
Mathematics Student-Level Item Analysis
1.NECAP results and new access codes were mailed to school principals in January 2012
2.Go to link below.
3.Select “Maine,” and then “Maine Reports” OR select “New England Common Assessment Program”, click on map of Maine, then “Maine Reports”.
http://iservices.measuredprogress.org
NECAP Mathematics Assessment - Data
Mathematics Student-Level Item Analysis
If your principal needs a reminder of these codes s(he) should call Measured Progress at 1-877-632-7774
http://iservices.measuredprogress.org
Maine’s Mathematics ProgressOver 3 Years
NECAP % Proficient NECAP Scaled Scores
Grade 2009 2010 2011 % Chang
e
2009 2010 2011 Point Change
3 62 61 64 +2 342 343 343 +1
4 62 60 66 +4 443 443 444 +1
5 64 60 64 0 543 543 543 0
6 63 63 65 +2 643 643 644 +1
7 60 58 61 +1 742 742 743 +1
8 59 59 60 +1 842 842 842 0
Maine’s Mathematics ProgressCohorts
NECAP % Proficient NECAP Scaled Scores
Grade 2009 2010 2011 % Chang
e
2009 2010 2011 Point Change
3 62 61 64 -- 342 343 343 --
4 62 60 66 +5 443 443 444 +1
5 64 60 64 +2 543 543 543 +1
6 63 63 65 +3 643 643 644 +1
7 60 58 61 -3 742 742 743 0
8 59 59 60 -3 842 842 842 -1
iServices – “Interactive” Tab
Released Items Summary Data
Multiple Choice Item
“Open Response” – including scoring guide and sample student responses to short answer and constructed response items
Item Analysis Report
Longitudinal Data
School Reports
NECAP Mathematics Instructional Strategies
Ideas for consideration:
Begin classes with a question of the day… Use a released NECAP question… multiple choice or short answer.
NECAP Mathematics Instructional Strategies
Ideas for consideration:
Have students create their own multiple-choice items aligned to the mathematics unit of instruction and learning goals. Challenge them to create four choices, including a correct answer and three good distractors. Have students explain what makes the distractors good choices.
NECAP Mathematics Instructional Strategies
Ideas for consideration:
Have students create their own short answer and constructed response items and corresponding scoring guides aligned to the mathematics unit and learning goals.
NECAP Mathematics Instructional Strategies
Ideas for consideration:
Embed a released NECAP question (or two) into a homework assignment.
NECAP Mathematics Instructional Strategies
Ideas for consideration:
Ask students to answer selected released items (constructed response, short answer and/or multiple choice items) at the end of a unit. Score and compare the results from year to year.
NECAP Mathematics – Uses for the Data
Ideas for consideration:
Reflect on your school programming
What are your strengths/weakness across areas?
Which students are served well/not served well?
NECAP Mathematics – Uses for the Data
Ideas for consideration:
Reflect on student misconceptions/thinking
Can your mathematics staff predict your student response patterns?
Can your staff predict student response patterns for disaggregated groups in your community?
NECAP Mathematics – Uses for the Data
Important ideas:
NECAP data is one tier (small but comparable) of a pyramid of student data intended to inform understanding of school program.
NECAP data must be supported and informed by classroom and school level formative assessment data for individual students.
NECAP Mathematics – Support Resources
Resources for consideration:
NCTM Principles and Standards of School Mathematics
NCTM Curriculum Focal Points
Helping Children Learn Mathematics
Adding It Up
NECAP Mathematics – Support Resources
Resources for consideration:
Curriculum Topic Study
Formative Assessment Probes
The Illustrative Mathematics Project http://illustrativemathematics.org/
CCSSM Implementation Timeline2010-2011: Year of Study – become familiar with the
documents and terminology
2011-2012: Begin implementing the 8 Standards for Mathematical Practice in your instruction and take an informal look at your current curriculum
2012-2013: Begin aligning/implementing your curriculum to the CCSS content standards (including the practices)
2013-2014: Continue aligning/implementing your curriculum to the CCSS content standards (including the practices)
2014-2015: Full alignment/implementation of the CCSS practice and content standards
New Assessments Aligned to CCSSCurrent plans are for the last NECAP assessment to
be administered in October 2013.
Maine is a member of the SMARTER Balanced Assessment Consortium with 26 other states, which is building an assessment system aligned to the CCSS to be implemented in 2014-15. The system will consist of optional interim assessments and a summative assessment consisting of computerized performance tasks and a computer-adaptive assessment administered in the Spring of 2015.
FMI - http://www.smarterbalanced.org/
Changes to NECAP During the Transition
There will be no changes to the NECAP Reading, Mathematics, and Writing tests in the fall of 2012.
There will be no changes to the NECAP Reading and Writing tests in the fall of 2013.
The fall 2013 NECAP Mathematics tests will have a limited number of changes due to differences with the CCSS
Changes to NECAP During the Transition
Test Grade
GLEs NOT Assessed in Fall 2013*
NECAP Mathematics
3 DSP 2-4
NECAP Mathematics
4 DSP 3-5
NECAP Mathematics
5 DSP 4-4, DSP 4-5, and GM 4-5
NECAP Mathematics
6DSP 5-5
NECAP Mathematics
7 DSP 6-4, DSP 6-5, FA 6-2, and GM 6-5
NECAP Mathematics
8 FA 7-2
*The GLEs that will be eliminated from testing—primarily because they have moved to a higher grade level in the CCSS—include concepts such as probability, combinations, similarity, and rate of change.
Maine’s NECAP Mathematics MDOE Website
Overview of the MDOE website and resources.
http://maine.gov/education/lsalt/index.htm
http://www.maine.gov/education/necap/index.html
Stay informed
MDOE Mathematics website http://www.maine.gov/education/lres/math/index.html
Mathematics Listserv https://list.terc.edu/mailman/listinfo/maine-math
The NECAP Mathematics Test
This presentation is recorded and posted at:
http://www.maine.gov/education/lres/math/index.html
andhttp://www.maine.gov/education/necap/presentations.html