Computerized Adaptive Testing for Students with Disabilities in K-12:

Promises and Challenges

Marty McCallSmarter Balanced Assessment Consortium

CCSSO – NCSAJune, 2015 – San Diego, CA

Conceptual Model of the Smarter Balanced Accessibility and Accommodations Framework

Embedded Tools

Universal tools

•Breaks•Calculator•Digital Notepad•English Dictionary•English Glossary•Expandable Psgs•Global Notes•Highlighter•Keyboard Navg.•Mark for Review•Math Tools•Spell Check•Strikethrough•Writing Tools•Zoom

Designated supports

• American Sign Language

• Braille

• Closed Captioning

• Streamline

• Text-to-Speech

• Color Contrast

• Masking

• Text-to-Speech

• Translated Test Directions

• Translations (Pop-up Glossary)

• Translations (Stacked)

• Turn off Any Universal Tools

Accommodations

Non-Embedded Tools

Universal tools

• Breaks

• English Dictionary

• Scratch Paper

• Thesaurus

Designated supports

• Abacus

• Alternate Response Options

• Calculator

• Multiplication Table

• Print on Demand

• Read Aloud

• Scribe

• Speech-to-Text

• Bilingual Dictionary

• Color Contrast

• Color Overlay

• Magnification

• Read Aloud

• Noise Buffers

• Scribe

• Separate Setting

• Translated Test Directions

• Translations (Glossary)

Accommodations

Change from paper to online

Advantages

• New ways to present items– audio– large print– filters – ASL, Braille, embossing

printers

• Expanded response modes– Input devices/keyboards– Interaction/engagement– Electronic supports

• Ability to standardize accommodations

Issues

• Innovative item types may not be universal

• Controversy over some tools

• Plethora of solutions causes high volume and complexity

Comfort levels change

• Used to be controversial– Electronic calculators– Keyboards– Spellcheck

• Still controversial– Not requiring decoding in reading– Translations

Accommodations available only to those who need them

Not controversial

Controversial

Making tests adaptive

• Components– Test blueprint

– Item Pool

– Algorithm

Advantages

• More precise scores, particularly for high and low performers

• Better information for growth models

• Student experience is more engaging– Questions are at an

appropriate level

Issues

• Enormous item pools, limited budgets. Need to prioritize

• Legal framework– Does every item need to

be available in every mode?

– Are translations all or none?

• Belief that students will not show skills

Thank you for your attention