2012 Standardized Testing and Reporting (STAR) Program

Multiple Choice TestsPre-Test Workshop for Test Site Coordinators

Middle and K-8 schools

Session One: 3:30-5:30 PMWednesday, 2/15/12–Montana Room

Session Two: 9:00-11:00 AMThursday, 2/16/12–Montana Room

Presented by:Mao J. Vang, Ed.D.

Sacramento City Unified School DistrictAssessment, Research and Evaluation, Box 780

5735 – 47th Ave.Sacramento, CA 95824

Tel. 916-643-9420Fax. 916-643-9474

Agenda

• Introductions• Objectives• New in 2012• Test Security• STAR Program Overview• Test Site Coordinator Responsibilities

– Multiple Choice Tests• Documents and Coding• Test Variations, Accommodations & Modifications• Preparing Documents for Return• Additional Resources• Questions & Answers

2

Objectives

• Provide an overview, key requirements, and administration information for the 2012 Standardized Testing and Reporting (STAR) Program

• Present the requirements for ensuring test security• Review required student demographic information• Preview required forms and how to complete them• Review how to package and return all testing

materials • Visit Training Resources for Test Site Coordinators

Webpage

3

Key Dates

4

STAR Grade Testing Window Materials Delivery Materials Pickup

Writing Tests        CST & CMA Writing Standards Tests

4 & 7March 6 (Make-up March 7)All schools with grades 4 and 7

February 27-March 2 March 8-9

Multiple-Choice Tests

       

CSTCMACAPASTS

2-11

Wave 1: March 27-May 3, 2012New Technology & Nonpublic Schools

March 19-23 May 7-11

Wave 2: April 18-May 18, 2012Traditional Calendar Schools, The Language Academy, & Yav Pem Suab Academy

April 9-13 May 21-24

Test materials must be ready for pick-up by 8:00 AM on the specific date(s) for pick-up. If you complete testing ahead of schedule, contact AR&E to arrange for early pickup.

New for 2012

• Testing window: 23 days• Answer documents

– Front: SEID added– Back: NPS moved– CAPA (shading of “5”) for Level I ONLY

• Writing tests– Reading aloud prompt now accommodation– Writing test can only be given in 1 day

• CMA– Braille for all– Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID answer

documents

5

New for 2012

• District home, hospital, independent study has a school code– If district has a program– Use new district CDS code

http://www.cde.ca.gov/ds/sp/cl/documents/ calpadsupdflash41.doc• Security Audits• Mark Discrimination Analysis

6

STAR Program Overview

• California Standards Tests (CST)Grades 2-11 for most students, includes separate writing test in grades 4 & 7

• California Modified Assessment (CMA)Grades 3-11 for students with IEP specification, includes separate writing test in grades 4 & 7

• California Alternate Performance Assessment (CAPA) for students with significant cognitive disabilities

• Standards-based Tests in Spanish (STS) English learners grades 2-11 whose primary language is Spanish and:– Receive instruction in Spanish, or– Have been enrolled in US school < 12 months

7

Testing Requirements

• All students enrolled on the first day of testing for each district in grades 2-11 needs to be assessed with one of the following:

– CST/CMA

– CAPA

8

Testing Requirements by CST Content

9

California Standards Test

Grade English Language Arts

Mathematics(Choose one end-of-course (EOC) completed in summer 2011 or will

complete in 2011-12 school year) Science Grade 8

History-Social Science Grade 8

Grade-level Math General Math Algebra I Geometry

7Required + separate

Writing Test

Required if not in Algebra I or higher

mathN/A EOC N/A N/A N/A

8 Required N/ARequired if not in Algebra I or higher math

EOC EOC Required Required

Testing Requirements by CMA Content

10

California Modified Assessment

Grade English Language Arts

Mathematics(Choose one end-of-course (EOC) completed in

summer 2011 or will complete in 2011-12 school year)

Science

Algebra I Geometry Science Grade 8

7 Available+separate Writing Test Available N/A N/A

8 Available Available Available Available

Note: If current Individual Education Plan (IEP) specifies CMA content area for a student, the student does not take that corresponding part on the CST.

CMA Participation

• Current IEP specifying CMA & content area(s)• Previous participation

– Previous CST Score of FBB or BB in subject area assessed and may have taken the CST with modifications; and

– 2 years scoring Proficient or Advanced on CAPA

• Not be eligible to take the California Alternate Performance Assessment (CAPA).

• Response to appropriate instruction– Receiving grade level instruction and has goals written to

grade level standards

11

Testing Requirements by CAPA Content

12

Note: If current Individual Education Plan (IEP) specifies CAPA for a student, the student takes CAPA for all content areas.

California Alternate Performance Assessment

Level Grades English Language Arts Mathematics Science

I 2-11 Required Required Required

II 2-3 Required Required Required

III 4-5 Required Required Required

IV 6-8 Required Required Required

V 9-11 Required Required Required

• Performance-based, one-on-one test • For students with significant cognitive disabilities

unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations

• Student must have an IEP • IEP specifies CAPA and level• Do not take STS• Answer document:

– Use only 2012 answer document– Ensure correct CAPA Level

is marked in 7a

CAPA Overview

13

CAPA Overview Continued

• CAPA is to be administered by trained licensed or certificated individuals

• 10% of the CAPA tests by level must be second rated• CAPA testing window is the same as the multiple-choice

window.• CAPA materials are include with multiple-choice

materials.• For questions regarding training for CAPA examiners,

contact: – Linda Kawahara-Matsuo, District CAPA trainer– Special Education Department– 643-9122

14

CAPA Observers

• Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS)

• Double ratings are randomly selected• Observers must mark Observer and BOTH examiners

and observers must sign the answer document

15

Preparing To Administer the CAPAObserver’s Answer Doc

1 – Name, etc.3 – Date of Birth5 – Name6 – Gender7a – CAPA Level7b – Grade11 – Student ID12a – SSID

Use blank from overage.Observers must mark sections

16

Testing Requirements by STS Content

17

Standards-based Tests in Spanish

Grade English Language ArtsMathematics

(Algebra I and Geometry are available for grades 8-11)

2 Available Available

3 Available Available

4 Available Available

5 Available Available

6 Available Available

7 Available Available

8 Available Available

9 Available Available

10 Available Available

11 Available Available

Note: Students in grades 8 who are not taking Algebra I or Geometry courses take NO STS math, but do take CST math.

STS Overview

• Required for English learners (ELs) in grades 2-11 whose primary language is Spanish and who either:– Receive instruction in Spanish regardless of the length of

time they have been enrolled in the U.S.; or– Have been enrolled in a school in the U.S. less than 12

cumulative months. • Not to be administered to English-only,

I-FEP, R-FEP, or dual immersion who do not meet the inclusion criteria stated.

• Students taking the STS must also take CSTs or the CMA• Students who take CAPA do NOT take STS

18

• Site Coordinator Segment– General, first part about security only– Refer to Site Coordinator Updates for 2012

Handout

View Training Video

19

Security Documents• The STAR Security Agreements from STAR test site

coordinators (principals) MUST be received by AR&E before test materials may be delivered to test sites.– Principals must review and sign the 2012 STAR Test

Security Agreement and send it to STARSupport@sac-city.k12.ca.us

• STAR test site coordinators MUST have a completed 2012 STAR Test Security Affidavit from test examiners before giving them testing materials.

20

Test Security Agreement and Affidavit

Send copies of all Test Security and Affidavits to STARSupport@sac-city.k12.ca.us or Box 780 by first day of multiple choice testing.

Sign by all others having access to STAR Tests

Sign by Principal or Designated Test Site Coordinator

21

Security Audits

• At randomly-selected schools and district offices• Before, during, or after testing• Are materials secure, accounted for, and when not

in use locked-up• Are correct administrative procedures being

followed: – Materials have been removed or covered– Students are not being coached through the exams– Only appropriate accommodations and or modifications

are being provided, et. al.

22

Mark Discrimination Analysis

• An automated process completed at the time of test booklet (grades two and three) and answer document scanning

• Identifies erasures to determine if the response has changed from:– Correct to wrong, or– Wrong to wrong, or– Wrong to correct, or

• From the analyses a report is produced and forward to the CDE who in turn requests districts to conduct an investigation based on the analyses

Wrong left wrong, orCorrect left correct, orNo response

23

Test Site Coordinator (TSC)Responsibilities Overview

• Attend training provided by district STAR coordinator (Assessment, Research and Evaluation-ARE)

• Study and become familiar with the documents and procedures: – 2012 STAR District and Test Site Coordinator Manual– Directions for Administration for at least one-grade level CST

and CMA– STAR Test Site Coordinator Summary of Responsibilities

Handout

24

TSC Responsibilities Overview Continued

• Schedule all tests and make-ups within the testing window (See sample schedules posted at Website)

• Inform teachers, students and parents of the testing schedule and where students are to report on the day tests are administered

• Train personnel at your site– Use Examiners Training Videos with Updates for 2012

Handout posted on Website– Use Test Examiners and Proctors Training Presentation

posted on Website– Obtain Security Affidavits from all personnel involved

25

TSC Responsibilities Overview Continued

• Monitor test administration• Handle defective test materials• Manage emergency situations

– Use Appendix C: STAR Program Irregularities and Incidents, pages 80-84 of manual

– Complete the appropriate report form and send a copy to the district coordinator

26

TSC Responsibilities Overview Continued

• Maintain the security of all testing materials– When conducting inventory, begin with Box 1 and use the Test Site

Packing List to verify that all materials were packaged accurately– Lock Freight Kit packet in secure place with test materials until needed– Contact Assessment, Research and Evaluation (643-9420) immediately for any

discrepancies.– Save original boxes for returning materials

• Distribute/collect test materials daily at your site– No test materials should be left in a classroom overnight– Use Inventory Forms posted at Website

• Ensure testing of all students in grades 2-11 • Act as liaison between your site and district coordinator• Obtain/return all test materials to/from district on time

27

Pre-identified (Pre-ID) Documents

• Pre-identified students have pre-printed answer documents

• Newly enrolled students (02/01-04/18/12)– Check for pre-printed label, if available, put it on answer

document and treat document the same as if pre-ID.– If no pre-printed label, hand-bubble all demographic fields.

28

CMA Materials 2012• CMA booklets for grade 3

– Separate scorable test booklet– If no CST taken, return CST test booklet with nonscorables

• CMA for Grades 4–7– CST and CMA in same answer document– Grade 5 ONLY allows calculator

(if written into the IEP)• CMA for grade 8 if at least one CMA test is pre-identified for a student,

the student will receive both the CMA and the CST pre-identified answer documents

• If both CST and CMA taken, must mark Section 7c for CMA tests taken

29

CST/CMA Answer DocumentRight side of inside of answer doc grades 4−7

CMA section has:

• Different subject icons from CST

• Alternate row shading for the response bubbles

• Three options choices

• Fewer number of questions

30

CMA Grade 7 Answer DocumentMathematics Section

Grade 7 mathematics and Algebra I have different numbers of questions

31

Coding Student InformationPre-ID Answer Documents

Pre-ID Barcode:Check student name and give to correct student

32

On the first day of testing, per teacher-read instructions, all students must complete Section 1

Coding Student InformationBlank Answer Documents

33

On the first day of testing, per teacher-read instructions, all students must complete Section 1

All demographic information must be hand-gridded.

Coding Student InformationTest Version Numbers (Gr. 8)

• Students will have 2 answer docs if they are taking CMA• Must mark version # for grade level tests and EOC tests Gr. 8 CST, pp. 2 & 3 Gr. 8 CMA, p. 2

3434

A2: Special Conditions• Test coordinator

completes A, E, M, P, & T

• Teacher completes C, F, L, X, Y, & Z

A4: English Learner (EL) Test VariationsExaminer completes if any EL variations were used

Coding Student InformationAfter Each Test

35

A3: Accommodations and Modifications

Examiner marks• whether student has

IEP or 504 Plan and • which accommodations

were used

36

• Two types of testing variations

– ALL – available for all students

– 1 – available if regularly used in the classroom

Testing Variations

37

• Students may use accommodations and/or modifications if – Specified in IEP or Section 504 Plan and – Regularly used in the classroom

• Accommodations and modifications are to be used only to allow a student to access the test, not to provide an advantage– Accommodations do not change what the test is measuring– Modifications change what the test is measuring

Note: Refer to Appendix E: Allowable Test Variations, Accommodations, and Modifications, pp. 87-91 in Coordinator Manual

Accommodations & Modifications

Preparing Documents for ReturnTranscribing and Voiding Documents

• Transcribe braille and large print (or not processed)

• Write VOID on any answer document(s), with marks,not to be scored; return with nonscorables

38

Preparing Documents for ReturnSchool Grade Identification Sheet (SGID)

• Complete for each set of answer documents or test booklets

• Check counts to be accurate• Place on answer documents

for correct – Grade– School (school code machine-

marked)

Pre-printed

39

Preparing Documents for ReturnComplete Master File Sheet

Write in:

• Number of SGID

• Number of Scorable Documents

• Totals

40

• Return with each school • Check counts to be accurate• Required with scorables if materials

were ordered:– Write “0” (zero), no blanks– If not tested, note that school did not

test

Multiple Choice Scorables Packing Order

41

Label Boxes for Return to District

Multiple Choice Tests (CST, CMA, CAPA & STS)

ScorableMaterials

Non-scorableMaterials

Orange Labels Green Labels

42

• Site Coordinator Segment– CST Middle School– Refer to Site Coordinator Updates for 2012

Handout

View Training Video

43

Additional Resources: Rosters• Rosters will be sent from STARSupport@sac-city.k12.ca.us:

– Pre-ID roster• Students’ demographic information that have been pre-coded on

answer documents or late labels– STS test roster

• Students who need to take STS– CMA test roster

• Students who have been identified to participate using CMA on one or more tests

– End-of-course test roster (Grades 7-11)• End-of-course tests based on student enrollment. Test site

coordinators need to verify– Pre-ID roster Code Conversion

44

Resources & Contact InformationAll training materials and updates will be posted on the district’s Internet:http://scusd.s468.sureserver.com/training-resources-test-site-coordinators

45

STAR Support Contact: Assessment, Research, and Evaluation5735 – 47th Ave.Serna Center, Box 0780 Phone: 643-9420 Fax: 643-9474Email: STARSupport@sac-city.k12.ca.us

Questions and Answers

46

?