1 michigan merit examination - plans and prospects edward roeber, mike radke & jim griffiths,...
TRANSCRIPT
1
Michigan Merit Examination - Plans and Prospects
Edward Roeber, Mike Radke & Jim Griffiths, MDEDiane Walters & John Nelson, ACT
2
Current MEAP High School Test
Spring testing (March-April, 2006)Fall retesting (late October-early November, 2006)English Language Arts (Reading and Writing), Mathematics, Science count for the Merit AwardSocial Studies also assessed but does not count for the Merit Award
3
Current Program
Grade 10Students take the MEAP High School Assessment to qualify for dual enrollment (assessment in fall or spring)
Grade 11Students take the MEAP High School Assessment to qualify for dual enrollment (in the fall) and the Merit AwardAll students take the MEAP in the spring (if they have not already passed the MEAP)
Grade 12Students take the MEAP in the fall or spring to qualify for the Merit Award
4
Current Program
Merit Award: $2,500 for passing the English language arts tests (reading and writing), mathematics and science at the high school levelMerit Award: $500 for passing the same subjects in grade 7 and 8 (each is assessed in each of these two grades)The Merit Award program may changePlease contact the Michigan Department of Treasury with ALL Michigan Merit Award questions
5
MME Legislation
PA 592 of 2004 - MME inserted into Career and Technical Preparation ActPA 593 of 2004 - Replaces high school MEAP with MME in School Aid ActPA 594 of 2004 - Replaces high school MEAP with MME in Postsecondary Enrollment Options ActPA 595 of 2004 - Replaces high school MEAP with MME for determining Merit Award ScholarshipsPA 596 of 2004 - Replaces the high school MEAP with MME in the School Code
6
Steps Used to Implement MME
Visited potential vendors to share/obtain ideasCompetitively bid the MME programReviewed the bidsSelected new contractor(s) - Pearson/ACTDetermined the content of each MME testConducted statistical alignment study (pilot test)
7
Spring 2006 Pilot High Schools
8
Steps Needed to Implement MME
Conduct additional content alignment studies neededSet cut scores on MME and MEAP Grade 11, to be used for the Merit Award and NCLB AYPPrepare revisions to the NCLB Accountability WorkbookEstablish PLAN and PSAT cut scores for dual enrollment purposes
9
Steps Needed to Implement MME
Submit application for approval to U.S. Department of Education by July 1, 2006November 1 is the “drop-dead date” for the MME versus MEAP HST decision for Spring 2007Receive approval from USED prior to drop-dead date OR continue MEAP High School Assessment (if approval is not received by that date)Implement the MME in grades 11 in the 2006-07 school year; maintain MEAP HST for Grade 12 only
10
MME Assessment Design
Grade 10: College entrance readiness test (PLAN and PSAT - local school/student choice)Grades 11 and 12: Michigan Merit Examination
English Language Arts - ACT Reading, Writing, and English; WorkKeys Reading for Information; Michigan Social Studies constructed response itemMathematics - ACT Mathematics; items from ACT Science; WorkKeys Applied Mathematics; Michigan items Science - ACT Science; Michigan itemsSocial Studies - Michigan items
11
Michigan Merit Examination Components and Score Contributions
Assessments Administered
Contributes to an English
Language Arts Score
Contributes to a Mathematics
ScoreContributes to
a Science Score
Contributes to a Social Studies
Score
•ACT Plus Writing
•WorkKeys Applied Mathematics & Reading for Information, plus Michigan Mathematics
•Michigan Science and Social Studies
Total ELA Score
Reading•ACT Reading (MC)•WorkKeys Reading for Information items (MC)
Writing•ACT English (MC)•ACT Writing (CR)•Michigan Social Studies CR item -writing score
•ACT Mathematics (MC)
•WorkKeys Applied Mathematics (MC)
•Selected ACT Science items (MC)
•Michigan items (Approximately 14 MC)
•ACT Science (MC)
•Michigan Science (46 MC)
•Michigan Social Studies (57 MC and 2 CR - social studies score)
Note: The number of Michigan items shown includes field-test items to replace those released annually.
12
MME Assessment Administration(Spring 2007)
Grades 11 and 12 - Spring AdministrationMarch 13 - ACT Plus WritingMarch 14 - WorkKeys + Michigan MathematicsMarch 14-21 - Michigan Science and Social StudiesMarch 27 - Makeup ACT Plus WritingMarch 28 - Makeup WorkKeys + Michigan MathematicsMarch 28-April 4 Makeup Michigan Science and Social Studies
13
MME Assessment Administration(Fall 2007)
Grade 12 - Fall Administration Saturday, October 27, 2007 (ACT National Test Date) - ACT Plus WritingTuesday, October 30, 2007 - WorkKeys + Michigan MathOctober 30 -November 6 - Michigan Science and Social Studies
14
Future Administration Dates
Session
Component 2008 2009 2010
Initial ACT Plus WritingWorkKeys+MathScience & SS
3/113/123/12-19
3/103/113/11-18
3/93/103/10-17
Makeup ACT Plus WritingWorkKeys+MathScience & SS
3/253/263/26-4/2
3/243/253/25-4/1
3/233/243/24-31
15
MME Test Center Establishment
Review several key documents (Spring 2006)Standard Testing RequirementsSchool Schedule and Site Options for Administration of the 2007 Michigan Merit ExaminationSummary of Test Administration PoliciesQualifications and Responsibilities for Test Supervisors and Back-up Test SupervisorsQualifications for Test Accommodations Coordinators
Consider staffing requirements and decide possible staff to fill these positionsPlan for testing rooms/facilities
16
MME Test Center Establishment (Fall 2006)
Week of September 4
Test Establishment Packets sent to high school principals
September 12 MME 2007 Briefing Video Conference
September 29 Establishment packets due back to ACT - Staff and facilities
October 2-13 Administrator Training Workshop invitations mailed
17
MME Test Center Establishment (Fall 2006)
October 20 Administrator Training Workshop reservations due to ACT
Week of October 23
Administrator Workshop Training confirmations sent via e-mail
November - December
Administrator Workshop Training conducted at 12 sites statewide
December 1 Offsite testing requests due to ACT
18
Assessment Sites
Preferred site is in a quiet wing of the high school
School in session for all students, orSchool for juniors only
Off-site administrationCommunity CollegeISD/RESAOther public facilityChurchOther private facility
Each site must be approved by ACT
19
Assessment Facilities
Choice of testing rooms for standard time administration
Uncrowded seating – prefer classrooms with 25-30 examineesManageable security – prefer no more than 100 examinees in one room (if more than 100, see personnel requirements)Good lighting, comfortable temperature, quiet atmosphere
Adequate writing surfacesNo lapboards permitted; temporary surfaces resting on chair arms or back of chair in front must be reviewed and approved by ACTMust accommodate both test booklet and answer document
20
Assessment Facilities
Seating arrangements (Applies Equally to Desks and Tables)
Seats must be assigned by testing staff as students enter room Minimum of 3 feet apart side-to-side (measured shoulder-to-shoulder)Minimum of 3 feet apart front-to-back (measured head-to-head)All students must face the same direction, directly behind one another
21
Assessment Facilities
Freedom from distractionsNo one not involved in testing may be in the roomUninterrupted testing period required for all days of testingNo unnecessary noises (bells, public address systems, etc. must be turned off)Testing rooms must be separated from regular school activities
22
Assessment Personnel
Required number of qualified assistants per room
1 room supervisor required for each room,Plus 1 proctor for every 25 examinees in the room after the first 25 (i.e., 26-50=1; 51-75=2; 76-100=3)
Testing staff may not beInvolved in test preparation outside of normal teaching responsibilities
Enrolled in high school
23
Avoiding Conflicts of Interest
Test (and Back-up) Test Supervisors have access to secure test materials prior to testing.To avoid the appearance of a conflict of interest, and to protect relatives (siblings, children, step-children, grandchildren, nieces, nephews) and wards from allegations of impropriety:
Test (and Backup) Supervisors may not be related to any examinee taking the ACT/WorkKeys in 2006-2007 anywhere in Michigan.Room supervisors and proctors may not assist in a room where any relative is being tested
24
Adequate Training for all Staff
ALL Test Supervisors (TS), Back-up Test Supervisors (Back-up TS), and Test Accommodations Coordinators (TAC) are REQUIRED to attend training in November-December, 2006.Testing staff must have read and be familiar with both the Day 1 and Day 2 supervisor’s manuals (included with training materials)
25
Adequate Training for all Staff
A local training session for all staff is required before testing (conducted by the Test Supervisor at each school)Each room supervisor must have a complete copy of that day's supervisor’s manual in the test room
26
Attentiveness
During testing, the testing staff must:Focus on monitoring testing (reading, grading papers, other personal work is not permitted)Circulate frequently around the room to monitor examineesRecognize the potential for cheating and take action as instructed in supervisor’s manuals
Exact compliance with supervisor’s manuals is required…including reading spoken instructions verbatim
27
Assessment Administration
All test sites must test on the designated daysThe testing activity should be the first activity of the day for studentsAssessment administration staff will need to review procedures 30 minutes prior to the start of testing.No food or drink are permitted in testing room(s) – this applies to both staff and examinees.
28
Security
Receipt, check-in, and verification of test booklets are by serial numbersRestricted access at all times from moment of receipt to return (documented “chain of custody”)Answer documents not returned to students after test responses are griddedAll test sites must test on the designated test days with testing as the first activity of the morning.Immediate and complete return of all Day 1 materials to ACT and all Day 2 materials to Pearson
29
Security
Proper identification of examinees by room supervisor (personal recognition or photo ID)Direct consultation with ACT to handle testing irregularitiesUnannounced observation of assessment administration in selected schools
30
Exact Timing of the Tests
More than one timepiece must be used in each room to ensure back-upTime remaining may not be posted Five-minute warning must be read verbatim from the supervisor’s manuals
31
Documentation of Test Day Procedures
State Testing Staff List returned with answer documentsSeating Diagram, Test Book Count Form, and Testing Time Verification Form returned for each roomSupervisor’s Report Form (Day 1) and School ID Sheet (Day 2) completed accuratelyTesting Irregularity Report Form(s) returned with answer documents
32
MME Year-by-Year Implementation
2005-2006Fall - MEAP HST (grades 10, 11, 12)Spring - MEAP HST plus statistical pilot linking ACT to the MEAP HST (grade 11 only)
2006-2007 (Assuming Federal Approval)Grade 10 - use PLAN or PSAT for dual enrollment
Local district selects test; state sets qualification score(s)Student or school district pays the testing cost (no state reimbursement)
Grade 11 - Offer MME in the Spring for Merit AwardGrade 12 - Offer MEAP HST to complete Merit Award (one year only) OR MME
33
MME Year-by-Year Implementation
2007-08 (No More MEAP)Grade 10 - use PLAN or PSAT for dual enrollment
Local district selects test; state sets qualification score(s)Student or school district pays the testing cost (no state reimbursement)
Grade 11 - Offer MME in the Spring for Merit AwardGrade 12 - Offer MME in the Fall and Spring
Students get one free (state-paid) re-take
34
Key 2006-07 MME Dates
March 6, 2006 - Video conference on MME assessment accommodations (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’)
April 27, 2006 - Video conference on 2006-2007 MME plans (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’)
May - June 2006 - Analyze pilot school information; prepare application to USED to change to MMEJuly 2006 - Submit application to USEDJuly-August, 2006 - Select Michigan items
35
Key 2006-07 MME Dates
September 12, 2006 - Statewide video conference on 2007 MMESeptember-October 2006 - ACT establishes schools as test centersSeptember-October 2006 – Home school students notify district high school of intent to testNovember 1, 2006 - Drop-dead date for USED approval to implement the MME; use MEAP HST if approval not receivedNovember-December 2006 - Mandatory training for Test Supervisors, Backup Test Supervisors, and Test Accommodations Coordinators
36
Key 2006-07 MME Dates
December 1, 2006 - ACT-approved accommodations requests due to ACT for Day 1 Testing (ACT Plus Writing)*January 10, 2007 - State-allowed accommodations requests due to ACT for Day 1 Testing (ACT Plus Writing)*For Day 2 (WorkKeys + Michigan Mathematics) & Day 2-7 (Michigan Science and Social Studies), tests accommodations should be similar to those approved for Day 1
Accommodations decisions for Day 2 and Day 2-7 are the local school district responsibility
*Dates also apply to home school and non-public school students
37
Key 2006-07 MME Dates
January 10, 2007 (Estimated) - Materials orders for ALL students are due for Day 2 (WorkKeys + Michigan Mathematics) & Day 2-7 (Michigan Science and Social Studies tests)
Submitted via Pearson School House for all studentsNovember 2006-January 2007 (Estimated) - Non-public school students using test centers registered for the MMEFebruary 2007 - Accommodations determined and materials orderedFebruary-March 2007 - Test Supervisors train test administrators and proctors
38
Key 2006-07 MME Dates
MME TestingDay 1 - ACT Plus Writing (March 13, 2007)Day 2 - + Michigan Math (March 14, 2007)Day 2-7 - Michigan Science and Social Studies (March 14-21, 2007)Special Testing Windows (March 13-28, 2007)
39
Key 2006-07 MME Dates
MME Makeup TestingDay 1 - ACT Plus Writing (March 27, 2007)Day 2 - WorkKeys + Michigan Math (March 28, 2007)Day 2-7 - Michigan Science and Social Studies (March 28-April 4, 2007)Special Testing Windows (March 27-April 11, 2007)
40
Key 2006-07 MME Dates
May-July, 2007Students receive their reports
Regular ACT reports (college-reportable)WorkKeys reportsMME score reports
Schools receive ACT, WorkKeys, and MME score reportsMME scores used for EducationYES! accreditation and NCLB AYP accountability purposes
41
Key 2006-07 MME Dates
August-September - Students register for MME October Retake via ACT (using a voucher available at their school)MME Fall Retake
Day 1 - ACT Plus Writing (Saturday, October 27, 2007)Day 2 - WorkKeys+Michigan Math (Tuesday, October 30, 2007)Days 2-7 - Michigan Science and Social Studies (Tuesday, October 30-Wednesday, November 6, 2007)Special Testing (October 27-November 13, 2007)
42
How do Students benefit from taking the ACT?
The ACT is universally accepted for college admission.The ACT is curriculum-based.The ACT is more than a test.
43
How do Schools benefit from taking the ACT?
Evaluate student readinessEvaluate/inform instructional programsDocument Progress and Success with the
EPAS®
systemEffectively advise & guide students
44
...a foundational skills development system, best known for translating a vague statement like "we need more math" into a precise set of teachable skills really used in a career. Educators - tailor development plans and certify career readinessEmployers - determine hiring qualifications and training needsEconomic and workforce developers - match employers and communities
45
Job Profiles Job Profiles Sept 00 - Aug 05Sept 00 - Aug 05 4,136
6%
17%
32%
43%
1%
All ExamineesAll ExamineesSept 04 - Aug 05Sept 04 - Aug 05379,546
17%
9%
7%
17%
25%24%
Applied Mathematics
6
3
5
4
7
46
Getting Started Now
Consider how and where the MME will be administeredMake sure IEP teams are considering accommodations needed for both high school assessments
MEAP HSTMME
Think about who will manage the MMETest Supervisor and Back-up Test SupervisorTest Accommodations Coordinator
Review information posted on www.michigan.gov/mme website
47
Helping Students Prepare for MME
Assure that the high school’s curriculum is aligned to state standards and benchmarks, the new high school content expectations, and ACT-assessed standards Assure that course content matches course titlesEncourage students to enroll in rigorous college preparatory classes (or equivalent ones that address the same content with the similar rigor)
48
Helping Students Prepare for MME
Have students participate in reasonable ACT prep activities
Use ACT or commercial products to practice taking a timed testBecome comfortable with the test formats
Focus on learning the skills defined in the standards and benchmarks rather than just practicing test-taking skills
49
Getting Started Now
Review past ACT high school assessment reportsWhat percent of students take the ACT?What percent of students take recommended college core courses?What is the performance of students taking college core versus those who did not?What are the trends over time?
What are the implications of ACT results?For counselors - better course-taking advice?For academic departments - improved rigor of courses?For districts - More rigorous graduations requirements?
50
Challenges
Assuring adequate assessment administration preparation - for very secure tests (ACT)Participation of students with disabilities
What accommodations will be needed? See MME website – “Spring 2007 Michigan Merit Exam (MME) Accommodations Summary Table.”Will MI-Access be used by some students?
Participation of English language learnersWhat accommodations will be offered and under what conditions? See MME website – “Spring 2007 Michigan Merit Exam (MME) Accommodations Summary Table.”
51
For Questions and Comments
Edward Roeber(517) 373-0739 [email protected]
Mike Radke(517) 241-0206 [email protected]
Jim Griffiths (517) 373-4332 voice
Michigan Department of EducationOffice of Educational Assessment & AccountabilityP.O. Box 30008Lansing, MI 48909
52
For More Information
For more information on MMEwww.michigan.gov/mme
For MDE assessment questions(877) 560-TEST (8378)
For ACT- or WorkKeys-specific [email protected]
For Pearson Educational Measurement(800) 204-4109
53
Thank you!
Video conference sites around MichiganWayne RESATCOM Consortium, Mistreamnet and the Sustained Learning RegionsSam LoPrestoPresenters and staffAnd You!
54
VHS Copies: $10.00 + $4.00 S & HDVD Copies: $15.00 + $4.00 S & H
Contact: Brenda Hose, [email protected]
Rebroadcast archived at http://www.mistreamnet.com
Powerpoint and attachments available on MEAP website:
www.michigan.gov/meap