virginias alternative assessments presented by: judy honaker 7-18-2007
TRANSCRIPT
Virginia’s
Alternative
Assessments
Presented by:
Judy Honaker
7-18-2007
Alternative Assessments NCLB states that “an alternate assessment is an
assessment designed for the small number of students with disabilities who are unable to participate in the regular State assessment, even with appropriate accommodations.”
Further, that “alternate assessments may be needed for students who have a broad variety of disabling conditions; consequently, a State may employ more than one alternate assessment. An alternate assessment may be scored against grade level standards…”
3 Types of Alternative Assessments
VAAP (students well below grade level)VGLA (students in grades 3-8-- who do
not have to earn verified credits by passing SOL tests)
VSEP (students who are enrolled in grade level classes that require an End Of Course Standard of Learning test to earn a verified credit)
Virginia's Alternate Assessment for Students NOT ON GRADE LEVEL
Only students with disabilities who have an IEP and who are not participating in any Standards of Learning assessments at their grade level (3, 5 and 8) may be considered for participation in the Virginia Alternate Assessment Program. (VAAP)
The student must demonstrate impairments that prevent the completion of curriculum based on the Standards of Learning even with program and assessment accommodations.
Also, the student's present level of performance must indicate a need for extensive, direct instruction and/or intervention in a life skills curriculum.
Finally, the student must require intensive, frequent, and individualized instruction in a variety of settings to show progress and acquire, maintain, or generalize life and/or functional academic skills.
Virginia Grade Level Alternative (VGLA) and Virginia Substitute Evaluation Program
(VSEP)
Both the VGLA and VSEP are grade level alternative assessment options allowing a student to demonstrate individual achievement and proficiency on Virginia’s SOLs through a collection of student evidence.
The VGLA is available at grades 3 – 8 in all content areas.
The VSEP is available for ALL End-of-Course tests at the high school level and/or the Modified Standard Diploma requirements for math and/or reading.
Identify Tests VGLA and VSEP
The content areas tested are dependent on the student’s grade and the local school division’s policies regarding testing of the general student population.
• VGLA and VSEP content areas mirror those of the division:Grades 3, = Reading, Mathematics, Science,
History/Social ScienceGrades 5, 8 = Reading, Mathematics, ScienceGrades 4, 6, and 7 = Reading and MathematicsContent Specific HistoryGrade 11 = Reading, Mathematics, Science, and
History
Identify Tests (cont’d)
History = VGLA and VSEP administered at the corresponding grade levels as history is assessed division-wide.
e.g., Virginia Studies SOL test administered division-wide at grade 4, then grade 4 VGLA students would submit a History entry at grade 4.
Identify Tests (cont’d)
Procedures: VGLA and VSEP
A student’s IEP team/504 committee examines the participation criteria established for the VGLA OR VSEP and finds that a student meets the criteria for participation.
The student’s properly composed IEP team/504 committee makes the determination of which assessment program/accommodation(s) are appropriate for a student with a disability.
AFTER participation decisions have been made and noted in the student’s current IEP…
VGLA: Grades 3 - 8 Participation Criteria
The student must have a current IEP/504-plan; As a result of a disability, the student demonstrates
his/her individual achievement of SOL content through means other than multiple-choice formats;
As a result of a disability, the student is unable to demonstrate his/her individual achievement on the SOL test for the assigned course or grade level using available accommodations and formats.
VAAP: Select ASOL
The teacher and student review and select Aligned Standards of Learning (ASOL) in each content area from grade level blueprints.
Consideration of ASOL for any test begins by reviewing the student’s grade level ASOL blueprint; before moving to lower or higher level blueprints.
The number of required ASOL selected is based on the content area reporting categories in the ASOL grade level blueprints.
ONE ASOL must be defended from EACH reporting category within a grade level blueprint.
VAAP: Select ASOL (cont’d)
VAAP: ASOL Per Content Area
Reading – 2
Mathematics – 5
History – 4
Science – 4
VAAP : Identify Evidence Types
Identify type of evidence that will best demonstrate individual achievement in the selected ASOL.
VAAP : Instruction in Content
Teacher instructs the student in the appropriate content and the student generates evidence of achievement related to skills and/or knowledge listed in the selected ASOL.
Collect Evidence
Throughout the school year, the student and teacher select the strongest evidence to demonstrate that the student can perform all or part of the stated skill.
• Data Identification System (DIS) Sticker required on each piece of evidence.
Evidence:
The VGLA and VSEP requires evidence that the student can demonstrate a level of achievement related to the selected standards.
Types of Evidence
A collection may consist of any of the following types of evidence:
Work sample Audiotape Videotape Anecdotal Record Interview Charts/Graphs
Evidence Continued Evidence must demonstrate knowledge
and/or skills in the SOL addressed.
Students should submit evidence for all of the SOL assessed from the test blueprints.
Evidence may prove more than one SOL.
All evidence must be solely the student’s work completed in the presence of a teacher or authorized school personnel.
Evidence: Data Identification System (DIS)
stickersDIS stickers are REQUIRED to be placed
on each piece of evidence submitted for the VGLA and VSEP.
DIS stickers will be provided based on enrollment counts to your DDOT
Evidence without DIS stickers will NOT be considered in scoring entries.
Data Identification System (DIS) Sticker
Content Area being submitted
Standard of Learning being defended
Bullet of SOL being defended (if applicable)
Check one or both
Content Area:SOL:Bullet:Inferred: Demonstrated
Content Area: MathematicsSOL: 8.14Bullet: cInferred: Demonstrated
Example:
VGLA/VSEP DIS
VGLA/VSEP DIS
COE Submission
5.4 The student will read fiction and nonfiction with fluency and accuracy.
a) Use context to clarify meaning of unfamiliar words;
b) Use knowledge of root words, prefixes, and suffixes;
c) Use dictionary, glossary, thesaurus, and other word- reference materials.
Evidence submitted must include everything in the stem as well as all of the bullets.
VGLA/VSEP DISContent Area: ReadingSOL: 5.4Bullet: bInferred: Demonstrated: X
5.4 b The student will read fiction and nonfiction with fluency and accuracy by using
knowledge of root words, prefixes, and suffixes.
5.4 c
The student will read fiction and nonfiction with fluency and accuracy by using a dictionary, glossary, thesaurus, and other word-reference materials.
5.4 a The student will read fiction and nonfiction with fluency and accuracy by using
context to clarify meaning of unfamiliar words.
VGLA/VSEP DISContent Area: ReadingSOL: 5.4Bullet: cInferred: Demonstrated: X
VGLA/VSEP DISContent Area: ReadingSOL: 5.4Bullet: aInferred: Demonstrated: X
SOL Disaggregation
5.7 The student will demonstrate comprehension of information from a variety of print resources.
b) Organize information on charts, maps, and graphs.
5.7 The student will demonstrate comprehension of information from a variety of print resources.
b)
Organize information on
charts,
maps, and
graphs.
SOL Check Sheet
Optional
SOL Dividers
Optional
VGLA Checklist
Optional
1.6 The student will identify and represent the concepts of one-half and one-fourth, using appropriate materials or a drawing.
2.4 The student will identify the part of a set and/or region that represents fractions for one-half, one-third, one-fourth, one-eighth, and one-tenth and write the corresponding fraction.
Because it is not properly labeled
EvidenceMayNot Be
Scored
EvidenceMayNot Be
Scored
K.6 The student will add and subtract whole numbers, using up to 10 concrete items.
1.9 The student will create and solve story and picture problems involving one-step solutions, using basic addition and subtraction facts.
EvidenceWillNotBe
Scored
EvidenceWillNotBe
ScoredBecause this worksheet doesnot include directions orteacher comments aboutthe activity.
3.4 The student will use strategies to read a variety of fiction and nonfiction materials.d) Use context to clarify meaning of unfamiliar words.Evidence
MayNotBe
Scored
EvidenceMayNotBe
Scored Because it is not properly labeled
Because it is not properly labeled
6.3 The student willb) identify and describe prime and composite numbers
Should not be the
sole piece of
evidence for 6.3b
Should not be the
sole piece of
evidence for 6.3b
Because this activity identifies
but does not describe prime and composite
numbers.
Required Components
Optional Components
Submit COE
At the end of the “testing window,” the collection of evidence (COE) is submitted to the local Division Director of Testing.
(Amy Merrihue & Committee)
Submit COE
A signed affidavit must accompany each VGLA/VSEP area submission stating that the work is that of the student alone using his/her accommodations. Work samples submitted must be solely that of the
student.
In the presence of a teacher and/or paraprofessional.
Submit COE
Affidavit of Student Performance I did not: fabricate, alter, or modify student work samples; present evidence that provides a negative image
of the student; provide accommodation/assistive device that is
not a part of daily instruction; and I am not aware that anyone else did so.
Affidavit ConsiderationsHand over hand instruction is NOT evidence
of student performanceCopying notes or information from other
sources DOES NOT demonstrate individual student achievement of the content, but rather the students ability to copy information
Information gained or restated during open-book, internet research, or guided reading activities DOES NOT demonstrate individual achievement with the content
VGLA Collection ComponentsA VGLA collection submitted for scoring to the local scoring team must contain the following:
A signed VGLA Affidavit of Student Performance that demonstrates the student’s sole ownership/authorship.
Types of evidence that demonstrate individual achievement on all SOL addressed.
A Virginia Grade Level Alternative (VGLA)Assessment Worksheet to be used for scoring.
VSEP Collection ComponentsA VSEP Course Work Compilation submitted for scoring to the Virginia Department of Education must contain the following:
A signed VSEP Affidavit of Student Performance that demonstrates the student’s sole ownership/authorship.
A completed Course Work Compilation Form indicating evidence and SOL associations.
Types of evidence that demonstrate individual achievement on all SOL addressed.
TIPS TO IMPROVE INSTRUCTION
Label, Label, Label!Read the stem & bullet completely and
address everything.Avoid “shortcuts.”Use SOL check sheets to guide
instruction.We are all in this together, so LET’S
WORK TOGETHER!
Scoring VGLA and VSEP Submissions
VGLA Procedures • The student’s VGLA collection and the
signed affidavit confirming that the work is that of the student alone are submitted to the LEA scoring committee.
A complete collection that provides evidence for all SOL from a given content/grade level that the student has addressed during the course of study must be submitted.
VGLA Scoring Teams Scoring teams must consist of at least three
members. At least one or more members must have
knowledge of the content area being scored. Scoring teams must come to consensus on
score points assigned for each Standard Of Learning contained within the blueprint for a specific test.
Scores for individual Standards Of Learning are weighted based on the general Blueprint established for each test.
VGLA Procedures • Based on the documentation and collection
review, the school division scoring team will assign the appropriate scores based on the scoring rubric identified by the Virginia Department of Education.
The Division Director of Testing is responsible for maintaining a local scoring team.
After receipt of all required materials, documentation, and collection evidence, the local scoring team will set up a date for review of submitted VGLA entries.
The local scoring team will use the online scoring system to rate student individual achievement in each SOL addressed for specific content/grade level VGLA submitted collection.
VSEP: EOC and Modified Standard Diploma Grades 9-12 : Participation Criteria
The student has a current IEP or 504 plan. The student is enrolled in a course or has passed a
course that has a Standards of Learning End-of-Course test and/or the student is pursuing a Modified Standard Diploma and seeking certification for having met the literacy and/or numeracy requirements.
The impact of the student’s disability demonstrates to the IEP team or 504 committee that the student will not be able to access the Standards of Learning assessments even with accommodations and therefore requires a substitute evaluation.
VGLA/VSEP Modified Standard Diploma Options
If a student, as an 8th grader, has passed the grade 8 Reading and/or mathematics test(s) using the VGLA; he or she may use the scores earned during that administration to meet the requirements for literacy and/or numeracy when identified as seeking an MSD;
Scores awarded VGLA submissions by local scoring teams are acceptable for MSD purposes. Student VGLA submissions do NOT have to be submitted to the Department for review.
Students in ninth grade or above earning an MSD who did not participate in the VGLA in eighth grade are required to participate in the VSEP to meet the MSD reading and math requirements.
VSEP Procedures The student and teacher use established
procedures to identify collection components to demonstrate individual achievement and proficiency of SOL for the EOC grade level and content area(s) (and/or numeracy and/or literacy) considered for the VSEP. examine the addressed SOL for the assessment(s) being
considered (Blueprint). select appropriate work samples that demonstrate content
stated in the blueprint. reflect demonstration of student knowledge and skills related
to the specific SOL. complete a Course Work Compilation that represents the
student's level of individual achievement and proficiency.
VSEP Procedures The student and teacher MUST use a Course
Work Compilation form to indicate evidence submitted for scoring. The CWC should mirror the Evaluation Plan submitted and
approved by the VDOE. Additional evidence may be submitted using the CWC, but a
CWC MUST contain evidence indicated and approved from the original Evaluation Plan
Evidence should demonstrate the student’s level of individual achievement and proficiency with EOC SOL
Score
Local scorers use a state-developed rubric to rate student achievement on the aligned standards included in each collection of evidence.
Ratings are entered into online scoring sheet.
VSEP ScoringVSEP entries are scored during scoring
events throughout the school year.Trained scorers will read and review each
submitted entry.All entries are scored at least twice by
different scorers with content area expertise.
Scores for individual Standards Of Learning are weighted based on the general Blueprint established for each test.
VSEP Procedures • The student’s VSEP Course Work Compilation
form, evidence, and the signed affidavit confirming that the work is that of the student alone are submitted to the school division Director of Testing based on the established testing date(s) for each division.
A complete Course Work Compilation provides evidence for all SOL from a given EOC and/or literacy and/or numeracy blueprint that the student has addressed during the course of study.
VSEP Procedures • Based on the documentation and
Course Work Compilation review, trained and authorized scorers will assign appropriate scores based on the scoring rubric. The Division of Assessment and Reporting and
Pearson Educational Measurement will establish a scoring institute.
All VSEP entries will be scored during the scoring institute, dates to be determined.
The VSEP Scoring System will weight and calculate proficiency levels.
Report
After local scorers complete score sheets, DDOT or designee enters scores into online scoring system.
Real-time reporting will allow the DDOT to print copies of the student’s Official Score Report immediately after entering scores.
Report (cont’d)
DDOT distributes Official Score Reports to schools, parents, and students.
Alerts resolved online.Summary reports for students will be
made available online after receipt of the Division Authorization To Proceed (ATP) from the DDOT.
VGLA Reporting
The online scoring system provides scoring and reporting for the Local School Division and directly to the Division of Assessment and Reporting.
Division Directors of Testing will be given log-on information and procedures for accessing and reporting scores for VGLA Administrations during spring score training.
VSEP Reporting
The computerized scoring system used during the scoring event provides real-time scoring to Department of Education authorized scoring teams. Pearson Educational Measurement will print out Official Score Reports during the scoring event. Scorers will sign Official Score Reports. Division Directors of Testing will receive Official Score Reports for VSEP students at the close of the scoring event.
VGLA Audit Procedures • All school divisions will be subject to
VDOE audits to monitor program implementation, scoring, and application of participation criteria. 10 to 15 percent of student submissions. provide VDOE audit staff with evidence used to
establish ratings. agreement or non-agreement between submitted
evidence and ratings provided. School divisions may appeal scores and/or audits
through an established appeals process.
Divisions will receive audit rosters from Pearson. Student entries identified for audits should be set
aside and maintained until instructed to send to the Division of Assessment and Reporting VGLA Audit Institute
DDOTs will receive shipping materials, instructions, and labels prior to the audit institute.
VGLA Audit Procedures (cont’d)
VSEP Procedures
• VSEP entries will not be audited. Each VSEP will be scored by state identified,
trained, and authorized scorers. Each VSEP entry will be scored by two scorers. Inter-rater reliability will be established by
examining the first and second scores on proficiency assigned to each VSEP entry.
If required, VSEP entries will be read a third time by a third scorer to resolve disagreements in proficiency levels.
Review reports
Appeal scoring, reporting, and/or process Who can initiate an appeal?
Parent, Student, Teacher, Division Justification for appeals?
Errors
Timelines-30 days after reports/audits
Resources
VAAP Procedural Manual Virginia Alternate and Alternative Test
Administrator’s Manual ASOL Blueprints www.doe.virginia.gov VDOE Office:
Division of Assessment and Reporting Virginia Alternate Assessment Program (VAAP)
Questions