illinois alternate assessment annual conference on best practices for nonpublic special education...
TRANSCRIPT
Illinois Alternate
Assessment
Annual Conferenceon Best Practices for Nonpublic Special Education Programs
November 20, 2008
Introductions Pearl A. Schneider
IAA CoordinatorStudent Assessment, ISBE
All information referenced in this presentation may be found on the IAA website:http://www.isbe.net/assessment/iaa.htm
IAA Agenda Overview
Where we’ve been What we’ve learned Adjustments Calendar Resources
IAA “Life Cycle” to Date: Fall 2006 Writing Pilot February 2007 Portfolios R, M, S Spring 2007 Writing Operational Fall 2007 Pilot R, M, S Spring 08 Operational for R, M, S, W 2009 adds Gr. 3 Writing to complete
operational test
2009 IAA Tests
Reading Gr. 3-8 and 11 Mathematics Gr. 3-8 and 11 Science Gr. 4, 7, and 11 Writing Gr. 3, 5, 6, 8, and 11
Concern #1:
51% of teachers attended a training session
This raises questions regarding the use of the trainer of trainers model. The accuracy of test administration and scoring may have been impacted.
09 IAA Training, Part 1:
Northern Illinois including ChicagoJanuary 26-30, 2009
Central and Southern IllinoisFebruary 2-6, 2009
The ISBE website has the training schedule posted. Dates of registration will be announced soon.
09 Training, Part 2:To ensure precise administration and
scoring, especially for those teachers who have not attended training:
Rubric language has been embedded in the teacher administration instructions.
IAA Scoring RubricLevel 4 - The student correctly performs the task without assistance or with a single repetition of instructions or refocusing. (The teacher can repeat the instructions without change one time with no additional prompting and no indication of right or wrong answer).
Level 3 - The student correctly performs the task with a general prompt.
Level 2 - The student correctly performs the task with a specific prompt.
Level 1 - The student does not perform the task at Level 2 or provides an incorrect response despite Level 2 support.
2009 IAA Task Layout:
•Page facing teacher – instructions and text•Page facing student – task and/or answer options
Present the primary task to the student. Say:
“Which picture shows only mammals?”Point to each option and say:
“A dog and a cat,” “A cat and a plant,” “Three bushes”
The student receives a score of 4 for a correct response.
If the student does not respond or responds incorrectly, repeat the primary task only once exactly as it appears. If the student again chooses an incorrect answer or does not respond, move to Level 3.
4
Turn the page to provide the general prompt to the student.
Re-present the primary task and answer options.
The student receives a score of 3 for a correct response. If the student does not respond or responds incorrectly, move to Level 2.
3
Indicate the correct answer and re-present the primary task and answer options. The student receives a score of 2 for a correct response. If the student does not respond or responds incorrectly, move to Level 1.
2
If the student does not respond or responds incorrectly at Level 2, the student receives a score of 1. 1
Correct Answer: A dog and a cat
Sample Science task: (Teacher Instruction Page)
The child sees B/W drawings in the test booklets.
a dog and a cat a cat and a plant three bushes
Say:
“Here are some rabbits. Rabbits are also mammals.”Turn back to the primary task page and re-present the primary task and answer options. 3
The Teacher Sees:
The child sees B/W drawings in the test booklets.
Present the primary task to the student. Say:
“Read the sentences with me. Which sentence is fiction? ”Point to each option and say:
“The man flapped his arms and flew away.”
“The teacher gave the class homework.” “There are seven days in a week.”
The student receives a score of 4 for a correct response.
If the student does not respond or responds incorrectly, repeat the primary task only once exactly as it appears. If the student again chooses an incorrect answer or does not respond, move to Level 3.
4
Say the general prompt to the student:
“A fairy tale is a kind of fiction because the story is imaginary.”Re-present the primary task and answer options.
The student receives a score of 3 for a correct response.If the student does not respond or responds incorrectly, move to Level 2.
3
Indicate the correct answer and re-present the primary task and answer options. The student receives a score of 2 for a correct response. If the student does not respond or responds incorrectly, move to Level 1.
2
If the student does not respond or responds incorrectly at Level 2, the student receives a score of 1. 1
Correct Answer: The man flapped his arms and flew away.
Sample Reading task: (Teacher Instruction Page)
The child sees B/W drawings in the test booklets.
The man flapped his arms and flew away.
The teacher gave the class homework.
There are seven days in a week.
Built-In Task Characteristics:Plus: Task-specific texts, symbols, and artwork
embedded in the task. The “General Prompt” embedded in the task (in
the event it is needed). All tasks would follow the same rubric “template”
for teacher administration instructions.
Flexibility in presentation of tasks and how the student responds would be maintained.
Some Things Never Change Assessment frameworks remain the same. IAA Participation Guidelines remain the same. Use of mode of communication specific to the
individual student remains the same. Options in types of student responses remains
the same. Score submission online remains the same. Content coverage is expanded, not changed. Training will be provided on administration of
the tasks.
Test Administration
IAA Preparation Resources
Expanded Teacher Instructions and materials lists provided in test booklets
Updated Implementation Manual(separate sections for Coordinators and Teachers)
Online User Guides (Coordinators/Teachers)
2009 IAA Score Sheet (Implementation Manual)
Preparations
Review the scoring rubric and the guidelines at all 4 levels. (Refer to the Implementation Manual and the tasks themselves.)
Stay true to student task as written in the test booklets. DO NOT CHANGE the content of the task.
Maintain order of answer choices as provided in the test booklets. DO NOT CHANGE the content of the choices.
Avoid cuing answers through body language, voice.
Utilize as needed*:
Enlarged art Hand-held manipulatives Visual aids and assistive technology Tactile forms of print and/or raised-line material Extra time and additional breaks for test taking in a quiet
setting Professional staff who provide student support to assist
with suggestions and material preparation.
* This list is not exhaustive.
Communication
Identify the student’s primary mode of communication and administer each task using this mode.
Verbal
Nonverbal
Sign Systems
Communication Books
Assistive Technology
Language issues (e.g., ELL)
Prepare the Student
Discuss/explain to the student what he/she will be asked to do during the assessment.
Provide the student with easy access to communication device(s), if typically used.
Review content-related pictures, words or voice output on the student’s communication system prior to beginning (make sure it works).
Ensure that hearing aid(s) and/or FM systems are in good working order.
Prepare the Environment
Eliminate competitive sounds or visual distractions that may divert the student.
Position the student to sustain attention.
Determine the best focal distance for the student to view/manipulate
the materials.
With the exception of assessing a score point of 4, each item isto be administered once, with sufficient time for a student to respond using his/her mode of communication, unless the item administration is interrupted and reasonably needs to be repeated from the beginning.
Note: Adequate wait time is defined as 3-5 seconds or longer (based on the student’s mode of communication).
How many times may I administer the primary task?
Score Point of 4
•To promote validity and reliability, educators assessing a score point of 4 may repeat the task once:
→ If upon initially administering the task, the student provides an incorrect answer or no response, repeat the task once without an indication of judgment (i.e., right or wrong answer) or assistance. → If the student provides a correct answer upon repetition of the task, the student is eligible to receive a score point of 4. → If the student provides an incorrect answer or no response
upon repetition of the task, move to the general prompt.
Concern #2:
Comparability to regular assessments in terms of content coverage.
“In states I have worked with, there tend to be more alternate assessment items than (ISBE) has developed.” (peer reviewer)
2009 Operational Test will contain:
Reading Math Science Writing
14 tasks4 FT Total: 18*
15 tasks4 FT Total: 19
15 tasks4 FT Total: 19**
7 tasks1 FT Total: 8
* Except Gr. 11 will have total of 15 tasks.** Except Gr. 7 will have total of 20 tasks. FT – field test task (pilot) for future tests
* Tasks 16-18 in the content area of Reading do not apply to 11th grade. Grade 11 has only 15 Reading tasks.* Task 20 in the content area of Science does not apply to grades 4 or 11. Only grade 7 has 20 Science tasks.
IAA Calendar - 2008Nov 3 – Dec 21: Profile update window for
Assessment Network ONLY OPPORTUNITY to update contact and
shipping information before spring 09 testing!!)
Dec 1: Last day to submit Test Window Modification request to ISBE.
IAA Calendar - 2009Jan 9: Pearson receives FINAL pre-ID file from SIS.
Used to create initial shipment of materials to districts and student rosters in SchoolSuccess (Pearson’s IAA online scoring system).
Jan 26 – Feb 6: IAA Regional Trainings
Feb 9: SchoolSuccess user ID and password is
emailed to coordinators.School Success website opens to allow
for creation of teacher accounts and classroom setup.
2009 IAA cont.
Feb 17: IAA test materials delivered to districts.
Feb 17 – Mar 9: IAA additional order window available on Assessment Network website.
Mar 2-20: Early Testing Window (waiver)
Mar 9-27: Regular Testing WindowMar 16 – Apr 3: Late Testing Window (waiver)
2009 IAA cont.April 3: Final day to enter IAA scores for
2009 testing. SchoolSuccess website closes at 11:59 p.m. No scores accepted after this time.
April 9: Pre-scheduled pickup of IAA test materials between 8 am – 5 pm
IAA Online Resources Implementation Manual Online Scoring User Guides Frameworks Scoring Rubric RCDTS codes Accommodations Guidelines www.isbe.net/assessment/iaa.htm
Pearson Contact Information Pearson’s Assessment Network
www.pearsonaccess.com/il
Pearson Customer Support [email protected]/627-7990 State Code 814
Pearson Online Scoring [email protected]/234-4849
ISBE Contact InformationISAT questions:
Dennis Goedecke [email protected]
PSAE questions:Megan Forness [email protected]
IAA questions:Pearl Schneider [email protected]
Assessment Division Phone: 217/782-4823