casas cde remote testing webinar, part 1: el civics coaaps ... · casas cde remote testing webinar,...
TRANSCRIPT
Comprehensive Adult Student Assessment Systems
April 20, 2020© 2020 CASAS www.casas.org
CASAS CDE Remote Testing Webinar, Part 1:EL Civics COAAPs and CITApril 30, 2020
Presenters:• Patricia Rickard -- President• Linda Taylor – VP Assessment Development• Jay Wright – California Accountability Program Manager• Janice Fera – National Technical Program Specialist
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
Agenda• Welcome
• CASAS EL Civics Remote Testing ▫ Overview▫ COAAPs▫ CIT
• May 4th: CA Remote Testing Webinar for Multiple-choice Tests▫ Pre/Post Tests▫ EL Civics Government & History Test
• Questions and Comments from the Field
• Next Steps
2
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 20, 2020 3
CASAS EL Civics Remote TestingOverview
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
OCTAE Guidance on Remote Testing• OCTAE’s April 17, 2020 (20-4) memo provides testing flexibility to states
• States may “allow local programs to exempt students enrolled in distance education programs from pre- and post-testing if a local program is unable to conduct testing due to the widespread effect of the COVID-19 pandemic…” (Q2)
• States must specify the time frame for COVID-19-related exemptions and identify students who are exempted from testing.
• OCTAE’s March 27, 2020 (20-3) memo, Q7 states that remote testing with NRS-approved tests must follow test publisher guidelines regarding:▫ Student identification▫ Test security▫ Remote proctor training
Additional information about this will be presented on Monday, May 4th.
4
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
• OCTAE met with all test publishers on April 9, 2020.
• CASAS met with OCTAE on Friday, April 17, 2020.
▫ CASAS has permission to roll out remote testing.
▫ OCTAE was “quite impressed” with our remote testing plan and timeline!
• CASAS conducted a webinar on Monday, April 20th
for state directors to inform them about remote testing.
5
OCTAE Guidance on Remote Testing
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
EL Civics Remote Testing Benefits• Good for students and teachers to see their progress ▫ Opportunity to assess students who have recently completed
significant learning▫ Provides students with helpful feedback▫ Keeps students engaged in learning▫ Provides closure and useful information for teachers
• Agencies can use this time to build capacity▫ Establish procedures▫ Train staff
• Be prepared for the future with distance learning as a regular and essential part of your program.▫ Many agencies are eager to pilot!
• Remote testing is the wave of the future for distance learning.
6
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
Remote Testing Challenges• Assessor and student access to technology (equity concerns)▫ Appropriate devices ▫ Internet bandwidth – competition with others in household
•Student test environment may lack:▫ Privacy▫ A quiet place to test without distractions
• New procedures ▫ Assessor training ▫ Revised agreements for agencies and assessors▫ New agreements for students
• Test security (more for CIT than COAAPs)
7
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
CASAS Approach to Remote Testing
• Conferred with CDE, consortium leaders, and agencies.
• Interviewed practitioners familiar with COAAPS, CIT and distance learning.
• Weighed multiple factors:▫ Ease of adaptation for remote testing▫ Test security▫ Ease of implementation ▫ Urgency to start quickly▫ Access to technology for both proctors and students
8
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
CASAS Approach to Remote TestingTest Security Measures• Local agencies are responsible to ensure test security!
• Remote testing agreements▫ Agency – one agreement per agency for all remote assessments▫ Test Administrator – needed for the CIT▫ Student – oral agreements given at the time of testing
Delivery • Agencies review current COAAPs and modify assessment procedures
for remote testing.
• Use a range of technology options for assessors and students.▫ COAAPs and CIT can be delivered low tech.
• Use existing assessors with additional remote test training.
9
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
CASAS Approach to Remote TestingTest Environment• The assessor must ensure that that student is alone and not getting
assistance from others.
• If possible, the student may be asked to sweep the room with a video camera before and after the test session to check if other people or items that are not appropriate during testing are there.
• Provide for accommodations, as needed.
Cost• Minimal cost for local program staff to select and adapt COAAP
assessment delivery for remote testing and train COAAP assessors• Minimal cost to train existing certified CIT test administrators and
set them up to test remotely10
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
CASAS EL Civics Remote Testing Implementation for COAAPs and CIT
11
Phase 1 In Progress • Clinical Tryouts and Pilots
Phase 2 Starting May 11th
• Roll out remote testing for COAAPs
• Roll out remote testing for CIT
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
•Agencies that intend to do remote testing must submit one remote testing agreement to their program specialist and CDE regional consultant.
•This agreement will cover requirements and agreements for COAAPs, CIT, Pre/Post, and Government and History tests. ▫ COAAP and CIT content will be covered today.▫ Pre/Post and G & H will be covered on Monday, May 4th.
•Agree to follow CASAS Guidelines for Remote Testing, including test security and privacy agreements.
•Provide estimated start date.
12
Agency Remote Testing Agreement
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 20, 2020 13
CASAS EL Civics Remote Testing for COAAPs
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
•The assessment delivery in most of your agency’s existing COAAPs can be modified for remote testing on computers or smartphones -- or with lower tech solutions.
•The key requirement is the ability to interact with the student “live” -- in real time.
14
COAAP Remote Testing Guidance
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020 15
Technology for COAAP Remote Testing
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
New!
16
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
“GoingRemote!” with COAAPs Phase 1 -- Pilots are in progress!
Phase 2 -- Rollout Steps
• Select COAAP and adapt assessment delivery▫ Read COAAP Guidelines for Remote Testing.▫ Revise COAAP assessment delivery as needed – not the Plan.▫ Identify feasible technology.▫ Determine process to verify student identity.▫ Determine methods for documenting and storing remote test results.
• Submit Agency Remote Testing Agreement to both your Program Specialist and CDE Regional Consultant ▫ List COAAPs to be used remotely. ▫ Describe revised assessment delivery for each COAAP.
• Train assessors in COAAP remote testing procedures.• Conduct trial runs between assessors.• Pilot with one or two classes and a limited number of students. • Revise COAAP assessment delivery as needed before rolling out to more classes.
17
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
• Assessors must agree to:
• Follow all privacy, test security, technology, and test administration requirements in the CASAS COAAP Remote Testing Guidelines.
• Document student agreements not to take assistance from others, and to follow all rules.
• Agencies should keep this on file with their Local Assessment Policy.
18
Assessor Remote Testing Agreement -- COAAPs
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
Training Tools
• COAAP Guidelines for Remote Testing document
• Training Webinars by Program Specialists to guide agencies in how to select and revise COAAP assessment delivery for remote testing
• COAAP Remote Testing FAQs
19
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
• Written responses can be made on paper while the assessor is watching, then displayed to the assessor using the camera. The assessor can then take a photo of the written response.
• Students need to be advised to have lined paper and a medium tip dark pen at their assessment location.
• If the student has both a computer and cell phone, you have the option to have the student text written responses while you observe them doing so.
• Adding specific line numbers, such as 1a, 1b, 1c, allows you to direct the student to a specific location and identify which item is being answered.
• A sample task sheet and student-made answer sheet is on the following slide.
20
COAAP Remote Testing Tips – Written Responses
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
• Written responses can be
21
COAAP 54 Sample
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
• You will usually be able to use your current oral assessments, asking the question remotely, noting the response of your student from a remote location, and recording responses using your existing rubrics.
• It is preferable to be able to view the student while the student responds. • Any video app (FaceTime™, Skype ™, Zoom ™, Google Duo ™) will work for
oral assessment.
• If using illustrations or pictures, they must display clearly on a phone. • Phone screens are small. Using multiple illustrations at the same time will
not work. Illustrations should not be extremely detailed.
• If using text prompts, the font size in your documents must also be readable on any devices being used. Calibri 20 -24 are the minimum sizes for a document to be clearly read on a smartphone screen.
22
COAAP Remote Testing Tips – Oral Responses
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020 23
COAAP Remote Testing Tips – Text Display
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
•This is a new process for all of us.
•We invite you to share your experiences with remote assessment and to make suggestions for how it can be improved.
•Meanwhile, please contact us if you would like to pilot some sample remote assessments. Your feedback on those assessment will be most helpful.
24
COAAP Summary Comments
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 20, 2020 25
CASAS EL Civics Remote Testingfor CIT
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
About the Citizenship Interview Test (CIT)
26
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
Technology for CIT Remote TestingPossible Devices• Phone with video camera OR
• Computer or tablet with webcam and audio
Possible Platforms• ZOOM™ (Windows, Android, Chrome, OS, iOS)
• WhatsApp™ (Windows, Android, Chrome, OS, iOS)
• Google Duo™ (Windows, Android, Chrome, OS, iOS)
• Skype ™ (Windows, Android)
• FaceTime™ (OS, iOS)
• Or any other platform that can be used by both the student and the CIT administrator
27
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
“GoingRemote!” with CITPhase 1 -- Pilots are in progress!
Phase 2 -- Rollout Steps• Read the CASAS CIT Guidelines for Remote Testing.▫ Decide if using paper or new electronic fillable version of test booklet.▫ Identify feasible technology.▫ Determine methods for entering in TE and storing remote test results.
• Identify CIT administrators and ensure that their certification is up to date.▫ This year, the deadline for CIT Recertification has been extended until May 31st.
• Submit Agency Remote Testing Agreement to both your Program Specialist and CDE Regional Consultant.
• CASAS will train existing CIT administrators in remote testing procedures.• Conduct trial runs between assessors.• Pilot with one or two CIT administrators and a few students. • Revise CIT local agency procedures and training as needed before rolling out to more classes.
28
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
New!
29
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
•CIT administrators who will administer the CIT remotely must complete this form.
•Local agencies must keep this form on file.
•CIT administrators must agree to ▫ Follow all privacy, test security, technology, and test
administration requirements in the CASAS CIT Remote Testing Guidelines.▫ Document student agreements not to take assistance
from others, and to follow all rules.
30
CIT Administrator Remote Testing Agreement
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
Training Tools
• CIT Guidelines for Remote Testing document
• Training Webinars by Program Specialists
• CIT Remote Testing FAQs
31
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 20, 2020 32
Questions and Comments from the Field
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 20, 2020 33
Next Steps
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
Next Steps
• Recording of the webinar, PPT and Chat Box responses will all be posted on OTAN and in the California Adult Ed Accountability and Assessment section on the CASAS website:
https://www.casas.org/training-and-support/casas-peer-communities/california-adult-education-accountability-and-assessment
• Contact your Program Specialist if your agency is interested in participating in pilots for remote testing of COAAPs or CIT.
34
www.casas.org CASAS CDE Remote Testing Webinar, Part 1: EL Civics COAAPs and CIT
April 30, 2020
Thank you for attending!
35
Facebook.com/CASASsystem@CASASsystemCASASAssessment
Be CASAS ConnectedUse #AdultEdu and #CASAScommunity to connect.
www.casas.org
1-800-255-1036