it takes a city · darian a. knicely, ed.s chief officer of accountability latifa hall, principal...
TRANSCRIPT
![Page 1: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/1.jpg)
It Takes a City It Takes a City to Knock it Out of the PARCC!
![Page 2: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/2.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Making the Transition from Pencil and Paper to Computer-based Assessments
Welcome!
LEA Leadership Institute, January 23, 2015 Gallaudet University
Ballroom B Washington, DC
Moderator: Dr. Tonya Mead, State Test Integrity Coordinator
![Page 3: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/3.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Making the Transition from Pencil and Paper to Computer-based Assessments
DC Prep Hilary Dauffenbach- Tabb, M.Ed, Assessment Associate Daniel Englender, B.S, Director of Academic Technology
Meridian Public Charter School- DC
Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator
Third Party Investigators
Ingrid Christian, Director Alvarez & Marsal Forensic Dispute Resolution
Lou Woodruff, Senior Security Consultant, Caveon Test Security
Moderator Tonya Mead, PhD, State Test Integrity Coordinator, Office of the State Superintendent of Education (OSSE)
![Page 4: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/4.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Agenda
I. Introduction
II. Case Studies
I. DC Prep
II. Meridian
III. Independent Investigators’ Perspective
IV. Discussion
V. Close
![Page 5: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/5.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Introduction Why make the transition?
• Obtain student assessment results in almost real time
• Reduce requirement for receiving, printing, storing, packing and shipping secure items
• Expand test format from multiple choice to adaptive
![Page 6: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/6.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Introduction
Challenges • Resistance to change Computer difficulties • Systems incompatibility Lack of resources
Solutions Provided by Case Studies • DC Prep • Meridian
Third Party Investigator Perspective • Caveon Test Security • A&M Forensic & Dispute Resolution
![Page 7: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/7.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
DC Prep
Presentation of Case Study
![Page 8: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/8.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
DC Prep Case Study Review
• Computer-Based Testing Logistics
• Preparing Students for Computer-Based Testing
– Using hardware
– Testing platforms
– Explaining test problems
– Checking for mastery
![Page 9: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/9.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
DC Prep Case Study Review
• Preparing Staff for Computer-Based Testing
– Reinforce similarities
– Develop routines
– Train teachers
– Process for support
– Debrief
![Page 10: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/10.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
DC Prep Case Study Review
Challenges Action Steps
Note-taking Computer based practice
Formatting Practice using tools
Connectivity Infrastructure testing
Technical Difficulties Chromebooks resolution
![Page 11: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/11.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Meridian
![Page 12: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/12.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Meridian Case Study Review
• Executive Summary
– Communication System and Establishing Clear Roles and Responsibilities
– Technology and Scheduling Issues
• Problem Analysis and Challenges
– Staff full time Testing Coordinator
– Manage the Schedule and Track Issues for Resolution
![Page 13: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/13.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Meridian Case Study Review
Challenge Who does what when ? Solutions: • Communication through grade level administrators • Weekly meetings and professional development activities
held • Testing Coordinator trains all staff • Testing Coordinator POC, Testing Committee 2nd POC • Chief of Accountability and Testing Coordinator manages
reporting, monitoring and investigation
![Page 14: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/14.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Meridian Case Study Review
Challenge Resolution of Technology Issues Solutions: • Create Form A and Form B Tracking System
– Form A- technical issues resolved by close of business – Form B- for students who have not arrived for
assessments • Designate days of the week to test run operating systems • Update commuters with programming required
![Page 15: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/15.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Meridian Case Study Review
Challenge Scheduling
Solutions: • Create schedule around lunch periods
• Test and refine the schedule throughout the year (general and pull out)
• Schedule is created by the Testing Committee
• Test Committee Members Representative of All Levels
– Executive Leadership
– Student Support, Technical Support and Data
![Page 16: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/16.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Investigator’s Perspective
• Caveon Test Security
• Alvarez and Marsal Forensic and Dispute Resolution
![Page 17: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/17.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Caveon Test Security
Test Security and
Data Forensics
![Page 18: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/18.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Caveon Test Security
• The Test Security Landscape
• How Computer-based Testing Reduces Cheating
• New Technologies offer new Cheating Opportunities
• How Computer-based Testing Introduces New Threats
• Data Forensics
![Page 19: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/19.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Alvarez & Marsal
Risk Assessment and
Control
![Page 20: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/20.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Alvarez & Marsal
• Transition of Test Security Risks
DC CAS to PARCC
• Categories of Risks
– Risks that exist for both Paper/Pencil and Computer-Based Testing
– Risks unique to Computer-Based Testing
• Control Updates Required
• Detection of Potential Test Security Violations
![Page 21: It Takes a City · Darian A. Knicely, Ed.S Chief Officer of Accountability Latifa Hall, Principal Jymece Seward, Test Coordinator Third Party Investigators ... PowerPoint Presentation](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f9a0b674ec740525d396baf/html5/thumbnails/21.jpg)
District of Columbia Office of the State Superintendent of Education It Takes a City • It Takes a City to Knock it Out of the PARCC!
Discussion and Close
• Questions and Answers
• Thanks
– The Office of the State Superintendent of Education Thanks the Expert Panelists for the Wealth of Information Shared and the Audience and Participants for Your Time and Attention!
Moderator: Dr. Tonya Mead, State Test Integrity Coordinator