using performance assessment to launch students and ... · diagnostic mya pba eoy optional....

64
Using Performance Assessment to Launch Students and Teachers Toward the Next Generation of Student Assessment Council of Chief State School Officers (CCSSO) National Conference on Student Assessment (NCSA) New Orleans, LA June 26, 2014

Upload: others

Post on 07-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Using Performance Assessment to Launch Students and Teachers Toward the Next Generation of Student AssessmentCouncil of Chief State School Officers (CCSSO) National Conference on Student Assessment (NCSA)New Orleans, LAJune 26, 2014

Page 2: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Using Performance Assessment to Launch Students and Teachers Toward the Next Generation of Student Assessment

Moderator: Michael J. Richards, Measured ProgressPresenters: Jennifer Briggs, Massachusetts Department

of EducationMary Beth Myers, Measured ProgressLauren Monowar-Jones, Ohio Department of Education Susan Tierney, Measured Progress

Discussant: Doug Sovde, PARCC, Inc.

Page 3: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

The Use of Standardized Tests

Page 4: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Testing

Why is everyone so stressed outover testing???

Page 5: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

From Policy to Implementation -THEN

NCLB (No Child Left Behind), 2001• Each state created its own assessment program using its

own academic standards (ELA and Mathematics)• MA has MCAS• OH has OAA and OGT

While these two states’ programs have been very successful, NCLB as a whole is perceived to have resulted in an over-emphasis on multiple choice and assessing recall of knowledge instead of application of knowledge, such as with performance assessment.

Page 6: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

What is a performance assessment?

Accomplish a task Explain

Generate

Solve

Converse

Conduct

“Authentic” Prevalent in 1980s and 1990s Universal application

Page 7: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Why do we need performance assessments?

Page 8: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

From Policy to Implementation -NOW

CCSS (Common Core State Standards), 2013• Common standards for all states (ELA and Mathematics)

• Two national consortia formed with many states joining:

• PARCC (Partnership for Assessment of Readiness for College and Careers)

• Smarter Balanced (Smarter Balanced Assessment Consortium)

• Some states remained independent

NGSS (Next Generation Science Standards), 2013• Each state chooses to adopt, in part or as a whole

• Eleven states so far (CA, DE, KS, KY, MD, RI, VT, WA, NV, IL, OR) – and DC

In both cases, the focus is on applying your knowledge at deeper levels of understanding

Page 9: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Fast Facts: MPAKS and OPAPP

Facts MPAKS OPAPP

Timeframe of Project

2012–2015 2008-2014Assessment

Stage Developmental Pilot and Field TestFunding Source Mainly RTTT Exclusively RTTT

Number of Teachers

54 teachers (maximum) 450 teachers

Number of Students

2,060 students (maximum) 22,500 students

Grade LevelsElementary

Middle SchoolHigh School

ElementaryHigh School

Content AreasELA

MathematicsScience

History/Social Studies

ELAMathematics

ScienceHistory/Social Studies

Career and Technical Pathways

Key Components

Grade 2 AssessmentsScoring involvementDevelopment model

Dyad ModelTeacher Involvement

Online Delivery

Page 10: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Presenter

Jennifer BriggsMassachusetts Department of Education

Massachusetts Performance Assessment of Knowledge and Skills (MPAKS)

Page 11: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

What is MPAKS?

A performance assessment consisting of a series of activities including both group work and individual work.

• Allows students to dive deeply into topic• Elicits high-level thinking skills• Results in multiple, individually-produced,

scorable products

Page 12: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Goal of MPAKSTo create positive, meaningful assessment experiences for both students and educators.To reach test takers with different strengths through a variety of assessment methods.To measure the progress and capabilities of students in different ways.

Page 13: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Why now?

Expanding upon traditional assessments

Preparing for realistic work environment

Page 14: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Where are we?

MPAKS is here.

Page 15: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Current Focus

Page 16: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Demonstration

What is the probability that the fifth coin flip will be heads?

Page 17: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Example – Grade 7 Mathematics

Page 18: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Example – Grade 7 Mathematics (continued)

Page 19: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Questions?

Jennifer BriggsMassachusetts Department of Education

Massachusetts Performance Assessment of Knowledge and Skills (MPAKS)

Page 20: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Presenter

Mary Beth MyersMeasured Progress

Massachusetts Performance Assessment of Knowledge and Skills (MPAKS)

Page 21: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Preparing to Launch Connection to

curriculum and standards

Manageability of administration

Accuracy and efficiency of scoring student responses

Page 22: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

What makes MPAKS different?

The people

The process

Page 23: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

MPAKS Advisory CommitteesCommittees Performance-based Assessment Assignments

Elementary 1. Grade 2 ELA2. Grade 2 Mathematics

Science and Technology/Engineering

1. Grade 4 STE2. Grade 7 STE3. High School Biology4. High School Physics5. High School Technology/Engineering

History and SocialSciences

1. Grade 4 HSS2. High School US History I

Page 24: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Assessment Development Sequence

Page 25: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Advisory Committee Activities

Page 26: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

The MPAKS Launch Crew

Performance Assessment Specialist

ELAContent

(and Scoring) Specialist

MathematicsContent

(and Scoring) Specialist

HSSContent

(and Scoring) Specialist

STEContent

(and Scoring) Specialists

Page 27: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Scoring Activities

Page 28: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Content Rubrics

Page 29: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Scoring Activities

Page 30: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Example – Grade 7 Mathematics

Task Activity

1

Step #1: Complete vocabulary handout.Step #2: Review answers.Step #3: Demonstrate a game of chance.Step #4: Design a game.Step #5: Discuss game ideas.Step #6: Explain your game.

2Step #1: Demonstrate your game.Step #2: Play your partner's game.

Page 31: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Grade 7 Mathematics Sample Revisited

Activity DescriptionNumber of Points

On what basis is it scored?

Step #6:

Explain your game.

Working independently, students answer questions about the game the teacher demonstrated.

Working independently, students explain their game by answering questions on the handout.

10 4 - Content

2 - Writing

4 - Accuracy

Page 32: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

What have we learned?

Heterogeneous composition of advisory committees works.

Development takes dedication and flexibility.

Scoring experts need to be involved early and remain involved throughout the process.

Page 33: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

What’s Next?

Another small-scale tryout

Distributed scoring pilot

Post-tryout meetings

Page 34: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Questions?

Mary Beth MyersMeasured Progress

Massachusetts Performance Assessment of Knowledge and Skills (MPAKS)

Page 35: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Presenter

Lauren Monowar-JonesOhio Department of Education

Ohio Performance Assessment Pilot Project (OPAPP)

Page 36: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Dyad Model

Page 37: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

PARCC and OPAPP

Diagnostic MYA PBA EOY

OPTIONAL

Page 38: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Overview

• Formative Instructional Techniques, Feedback and Re-engagement

Prof Learning

• Learning Task• Assessment TaskPilot

• Assessment Task• Look-backScore

• Write Learning TaskProf

Learning

Page 39: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Professional Learning

Page 40: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Teachers Talking

Page 41: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Questions?

Lauren Monowar-JonesOhio Department of Education

Ohio Performance Assessment Pilot Project (OPAPP)

education.ohio.gov/opapp

Page 42: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Presenter

Susan TierneyMeasured Progress

Ohio Performance Assessment Pilot Project (OPAPP)

Page 43: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

OPAPP

Notes from the development perspective…

Page 44: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

PERFORMANCE

Performance Assessments

Page 45: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Performance Assessments - Dyad ModelEmbed opportunities for assessment of

performance into curriculumProvide opportunities for formative

assessment and decision-making Practice on skills not easily assessed using

paper-pencil testsProvide an opportunity for assessment on

skills after practice

Page 46: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Life Cycles (Elementary Science)

Page 47: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Life Cycles (Elementary Science)

SESSION 1 SESSION 2 SESSION 3

• Pre-assess• Engage • Activate prior

knowledge

Page 48: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Life Cycles (Elementary Science)

SESSION 1 SESSION 2 SESSION 3

• Pre-assess• Engage • Activate prior

knowledge

• Conduct scaffoldedinvestigation

Page 49: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Life Cycles (Elementary Science)

Page 50: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Life Cycles (Elementary Science)

SESSION 1 SESSION 2 SESSION 3

• Pre-assess• Engage • Activate prior

knowledge

• Conduct scaffoldedinvestigation

• Share observations and results

• Construct conclusion

• Analyze results

Page 51: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Life Cycles (Elementary Science)

SESSION 1 SESSION 2 SESSION 3

• Pre-assess• Engage • Activate prior

knowledge

• Conduct scaffolded, hands on investigation

• Share results• Construct

conclusion• Analyze results

Page 52: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Life Cycles (Elementary Science)

SESSION 1

SESSION 2

SESSION 3

LEARNING TASK

ASSESSMENT TASK

• Similar skills and content

• Demonstration of mastery

Page 53: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Student Responses Life Cycles Assessment Task

Page 54: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Student Responses Life Cycles Assessment Task

Page 55: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Student Responses Life Cycles Assessment Task

Page 56: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

ASSESSMENT TASKS

FACT RECALL DEMONSTRATE

SKILLS

Page 57: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

“Hi!! I just finished Task 1 about life cycles with my class at the computer lab. We had a fun time and I heard students saying this is fun!!! The sentences that they typed were wonderful!!! Thanks for all you are doing for this.”

~3rd grade Teacher, Liberty Union

Page 58: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Teacher Task Training Consisted of:Instruction on

specifications, templates, rubrics, and on-line authoring Small group discussionsTeacher work sessions

Resources:Task specificationsTask templates Example rubricsPeer feedback

Page 59: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Teacher Task Training

What worked ◦Having time to work on tasks◦Having opportunity to collaborate

What didn’t work as well◦ Following-up after the workshops ended◦ Providing feedback via email

Page 60: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Challenges for Teachers Writing TasksMany teachers reverted back to what they had

always doneScience Lack of inquiry Lack of scientific process skills

Math Lack of incorporating practices Not letting go of algorithms

Page 61: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Challenges for Teachers Writing Tasks (continued)

ELA Lack of submissions or too few submissions Lack of informational text inclusion

Social Studies Lack of skills identified or used Lack of opportunity for students to make choices

Page 62: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Questions?

Susan TierneyMeasured Progress

Ohio Performance Assessment Pilot Project (OPAPP)

Page 63: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Discussant

Doug SovdePARCC, Inc.

Using Performance Assessment to Launch Students and Teachers Toward the Next Generation of Student Assessment

Page 64: Using Performance Assessment to Launch Students and ... · Diagnostic MYA PBA EOY OPTIONAL. Overview • Formative Instructional Techniques, Feedback and Re-engagement Prof Learning

Moderator: Michael J. Richards, Measured ProgressPresenters: Jennifer Briggs, Massachusetts Department

of EducationMary Beth Myers, Measured ProgressLauren Monowar-Jones, Ohio Department of Education Susan Tierney, Measured Progress

Discussant: Doug Sovde, PARCC, Inc.

THANK YOUQuestions?