smarter balanced assessment consortium · adverbials, passive voice, reported speech) vocabulary...
TRANSCRIPT
![Page 1: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/1.jpg)
Smarter Balanced Assessment Consortium
Magda Chia, Ph.D.Director, Support for Under-represented Students
Council of the Great City SchoolsAccessibility and Accommodations Webex
Tuesday, June 25, 2013
1
![Page 2: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/2.jpg)
Agenda• Smarter Balanced, Overview
• Accessibility and Accommodations, Overview
• Translations – Translations background– Gathering information for decisions– Selecting the best translation option– Selecting languages
• Examples
![Page 3: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/3.jpg)
Smarter Balanced Overview
![Page 4: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/4.jpg)
• 21 Governing States, 4 Advisory States, 1 Affiliate Member
• Washington state is fiscal agent
• WestEd provides project management services
A State-led Assessment Consortium
![Page 5: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/5.jpg)
Page 5
![Page 6: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/6.jpg)
Assessment System - Structure
Page 6
![Page 7: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/7.jpg)
Accessibility and Accommodations Overview
![Page 8: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/8.jpg)
Conceptual Model
![Page 9: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/9.jpg)
Research: Pilot Test
• Cognitive labs– Oversampled under-represented populations– Research questions directed at SWD
• Small-scale trials– Examine AI Scoring for ELLs and SWDs
• Item development– Linguistic complexity evaluation– Construct-irrelevant language identification– Psychometric studies on special forms
• Read aloud, Braille• Translations, glossaries
![Page 10: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/10.jpg)
Research: Pilot Test Student Results
• Gather information about the process of providing accommodations and results of offering them
• Provide feedback to states, work groups, experts
• Incorporate what we learn into field test development work
![Page 11: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/11.jpg)
Language Complexity-example
Descriptors
TEXT COMPLEXITY
1 2 3 4
Information Density
An average of one to three verbs, nouns or adjectives per sentence
An average of four to six verbs, nouns or
adjectives per sentence
An average of seven to ten verbs, nouns or
adjectives per sentence
An average of greater than 10 verbs, nouns or adjectives per sentence
Passage Length One to three paragraphs
Four to six paragraphs Six to ten paragraphs More than ten paragraphs
LANGUAGE FORM AND STRUCTURE
Language Forms Mostly simple
sentences and/or grammatical forms
A few more sophisticated
sentences and/or grammatical forms (e.g., compound S,
prepositional phrases)
A mix of sophisticated and simple sentences or grammatical forms
A substantial number of more complex sentences and/or grammatical forms
(e.g., relative clauses, adverbials, passive
voice, reported speech)
VOCABULARY
Vocabulary All high frequency, commonly used vocabulary
Few content‐specific,, metaphoric,
uncommon meaning, or idiomatic words
A number of content‐specific, technical,
metaphoric, uncommon meaning
and/or idiomatic words or expressions
A large number of content‐specific,
technical, metaphoric, uncommon meaning' or idiomatic words or
expressions
Source: Cook and MacDonald (2012). Presentation for Smarter Balanced Assessment Consortium.
![Page 12: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/12.jpg)
Translations Overview
![Page 13: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/13.jpg)
Translations Background
• Need for linguistic supports
• Smarter Balanced to offer a translation option
• Five languages– Spanish– American Sign Language– Three other languages
![Page 14: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/14.jpg)
Key Questions• Gathering information
– State information: Survey and Pilot– Experts: Framework and ELL Advisory Committee
• Translation option– Address dialects– Customized for grade, context– Construct-irrelevant terms
• Languages– Top 4 consortium-wide (plus ASL)?– Common among several states?– Individual state languages?
![Page 15: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/15.jpg)
Experts• Jamal Abedi• Edward Bosso• Donna Christian• Richard Duran• Kathy Escamilla• James Green• Kenji Hakuta• Okhee Lee• Robert Linquanti• Maria Santos• Guadalupe Valdes
• Guillermo Solano-Flores
• Judit Moschkovich• Judith Scott
![Page 16: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/16.jpg)
Translation Options
Solano‐Flores, G. http://www.smarterbalanced.org/wordpress/wp‐content/uploads/2012/09/Translation‐Accommodations‐Framework‐for‐Testing‐ELL‐Math.pdf
![Page 17: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/17.jpg)
Validity and Effectiveness
Abedi, J. and Ewers, N. http://www.smarterbalanced.org/wordpress/wp‐content/uploads/2012/08/Accomodations‐for‐under‐represented‐students.pdf
![Page 18: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/18.jpg)
Validity and Effectiveness
Abedi, J. and Ewers, N. http://www.smarterbalanced.org/wordpress/wp‐content/uploads/2012/08/Accomodations‐for‐under‐represented‐students.pdf
![Page 19: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/19.jpg)
Validity and Effectiveness
Tool Validity Effective‐ness
Overall Decision
Dual LanguageTranslation
Unsure Unsure Use/Moderate Risk
Pop‐up glossary (CBT)
Use Use Use
![Page 20: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/20.jpg)
Translation Model 1
Solano‐Flores, G. http://www.smarterbalanced.org/wordpress/wp‐content/uploads/2012/09/Translation‐Accommodations‐Framework‐for‐Testing‐ELL‐Math.pdf
![Page 21: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/21.jpg)
Translation Model 2
Solano‐Flores, G. http://www.smarterbalanced.org/wordpress/wp‐content/uploads/2012/09/Translation‐Accommodations‐Framework‐for‐Testing‐ELL‐Math.pdf
![Page 22: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/22.jpg)
Smarter Balanced State Language Survey
• Number of LEPs– By language– By grade
• Recently arrived LEPs– By language– By grade
• Current supports– Assessment used for accountability– By content area– For appropriate grades
![Page 23: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/23.jpg)
Languages for Translation
• High Frequency*– Spanish (79%)– Vietnamese (2.3%)– Arabic (2.0%)– Tagalog (1.3%)– Cantonese (1.1%)
• More than one state– Somali (Main and North Dakota)
* Consortium is committed to providing ASL and Spanish
– Mandarin (0.9%)– Korean (0.8%)– Russian (0.8%)
![Page 24: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/24.jpg)
Languages for Translation
• Low Frequency/Highly Concentrated– Hawaiian (Hawaii)– Ilokano (Hawaii)– Dakota (North Dakota)– Hutterite (South Dakota)– Karen (South Dakota)– Lakota (South Dakota)– Ojibwa (North Dakota)– Yup’ik (Alaska)
![Page 25: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/25.jpg)
Translations: Scope• Provide qualified experts
• Math translation option for specified languages– Items– Reporting– Supporting materials in formative assessment
• Full human video translation in American Sign Language – Math items– ELA listening items
![Page 26: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/26.jpg)
Examples
![Page 27: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/27.jpg)
Examples• https://sbacpt.tds.airast.org/student/lo
gin.aspx?c=SBAC_PT• Sign in• Grade 3, 7, or 11• Start G[3] Math• Word List: ‘Spanish Glossary’• Select
![Page 28: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/28.jpg)
Matching
![Page 29: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/29.jpg)
“Table”
![Page 30: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/30.jpg)
Table
![Page 31: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/31.jpg)
Drag and Drop
![Page 32: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/32.jpg)
Equal to 5.42 NOT Equal to 5.42
2.36 + 3.06
1.80 x 3
2.16 + 3.36
9.53 – 4.11
2.71 x 2
8.01 – 2.69
Table
![Page 33: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/33.jpg)
Translation
![Page 34: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/34.jpg)
Translation
![Page 35: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/35.jpg)
Translation
![Page 36: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/36.jpg)
Translation
![Page 37: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/37.jpg)
Embedded
![Page 38: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/38.jpg)
Embedded
![Page 39: Smarter Balanced Assessment Consortium · adverbials, passive voice, reported speech) VOCABULARY Vocabulary All high frequency, commonly used vocabulary Few content‐specific,, metaphoric,](https://reader034.vdocuments.us/reader034/viewer/2022051807/6006affc5545f64e9f148cdb/html5/thumbnails/39.jpg)
THANK YOU