training -- short-cycle assessment evaluation (part 2)
DESCRIPTION
Training -- Short-Cycle Assessment Evaluation (Part 2). New Mexico Public Education Department February 2010. SCAs Are Evaluated on Technical and Functional Quality. The SCA Evaluation Rubric specifies technical criteria for approval: Aligned with content standards or SBA; - PowerPoint PPT PresentationTRANSCRIPT
Training -- Short-Cycle Assessment Evaluation (Part 2)
New Mexico Public Education Department
February 2010
The SCA Evaluation Rubric specifies technical criteria for approval:
1. Aligned with content standards or SBA;
2. Psychometrically reliable;
3. Unbiased to subgroups;
4. SCA and SBA correlated.
SCAs Are Evaluated on Technical and Functional Quality
• Alignment Studies on PED High School Redesign Webpage: http://www.ped.state.nm.us/HighSchoolRedesign/
• Report on SCA reliability on vendor webpage or request from vendor.
• Report on item bias on vendor webpage or request from vendor. District developed SCA do own study of bias.
• Analyze correlation between SBA and SCA. • Technical Requirements Certification Form
Only Lead Districts Submit Rubric & Evidence for Technical
Requirements
• Explains what evidence is required.• Special conditions related to scoring or collection of information.
How to Complete the Rubric -- Guidance
• Explains what reports, data, or information is needed.• Specifies formats of submission (PDF, web link, form, etc.).
How to Complete the Rubric -- Evidence
• Spreadsheet space for recording required information.
How to Complete the Rubric -- Data
• Explains simple scoring schema.
How to Complete the Rubric -- Scoring
• Spreadsheet space for recording scores.• Districts score all categories but Alignment (Districts
complete=“Information Needed”, PED complete=“For PED Use”).
How to Complete the Rubric – Points Awarded
• PED reviews evidence and scores and assigns status based on rubric.
• Additional information or clarification might be necessary.
• If approval not granted, district negotiates needed improvements for next evaluation cycle.
• If approval not received in next evaluation cycle, select an approved SCA.
How to Complete the Rubric – Status
• NWEA MAP
• Riverside Assess2Learn
• Pearson Learnia
• Scholastic
• Discovery
• ACT Compass
Which SCAs Evaluated in Spring 2010?
• Basic Achievement Skills Inventory
• CTB McGraw-Hill
• Ed Performance
• District Develop SCA (Clovis Municipal Schools)
Which SCAs Evaluated in Summer/Fall 2010?
Short-Cycle Evaluation Schedule, 2009-2010Activity Deadline Requirement
SCA Evaluation Training Available Starting Monday,
March 1, 2010
SCA Evaluation Training PowerPoint slides (audio) available from http://www.ped.state.nm.us/AssessmentAccountability/AssessmentEvaluation/index.html.
Question & Answer TeleconferencesFrom 3 to 4 PM on
March 1, 3, and 4
If questions still remian after training and reviewing Rubric and Guidebook, contact Darlene Frank to register for a teleconference [email protected].
PED Monitoring WebTool Window Opens for SCA Evaluation Monday, March 01, 2010
PED Monitoring Web Tool invitations emailed to DTCs and charter school and State education institution school test administrators.
Districts Select Lead District for Analysis 3/12/2010 by 5:00 PM
Lead Districts submit a Lead District Partner Form in PED Monitoring WebTool.
Complete Rubric and Submit Evidence on PED Monitoring WebTool 4/23/2010 by 5:00 PM
Submit completed rubric and evidence to PED Monitoring WebTool. SCAs for this evaluation cycle include NWEA MAP, Riverside Assess2Learn, Pearson Learnia, Scholastic, Discovery, and ACT Compass.
PED Posts SCA Approvals on Website 5/28/2010 by 5:00 PM
PED Approves SCAs and posts rubric results at http://www.ped.state.nm.us/AssessmentAccountability/AssessmentEvaluation/index.html.
2009-2010 Evaluation Cycle Completed
Phase 3 SCA Alignment Studies Completed
6/30/2010 by 5:00 PM
Alignment study of following SCAs: Educational Performance, CTB McGraw-Hill, Basic Achivement Skills Inventory, and Teacher Developed Assessments (Clovis Municipal Schools). Report on PED High School Redesign webpage http://www.ped.state.nm.us/HighSchoolRedesign/
Schedule for 2010-2011 SCA Evaluation Cycle
To Be Determined
2010-2011 evaluation cycle will include the following SCAs: Basic Achievement Skills Inventory, CTB McGraw-Hill and Ed Performance assessments, and district developed assessments used by Clovis Municipal Schools.
• Use Monitoring login and password or contact Web EPSS helpdesk to obtain access.
• Web EPSS Monitoring User Guide
How Do I Access the Web Tool?
• Short-Cycle Assessment Evaluation Guidebook in Web EPSS.
• Q & A Teleconferences.
• Questions about Evidence or Rubric:– Robert Romero 505.827.6524 or [email protected]– Diana Jaramillo 505.827.6570 or [email protected]– Dr. Tom Dauphinee 505,827.6528 or [email protected]
• Questions about the Web Tool:– Web EPSS Helpdesk at [email protected]
• Questions about SCA Scale Scores or SCA/SBA Correlation:– Dr. Cindy Gregory 505.827.6508 or [email protected]
Is Guidance Provided?