![Page 1: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/1.jpg)
Introduction to RubricsYao Zhang Hill, Ph.D.
Assessment OfficeUniversity of Hawai’i at Mānoa
Hii, Y. Z., (2017, August). Introduction to Rubrics [PowerPoint slides and notes]. Workshop presented at National Foreign Language Resource Center Intensive Summer Institute: Pathways to Project-Based Language Learning, University of Hawai'i at Mānoa, Honolulu, HI
![Page 2: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/2.jpg)
What’s your experience with rubric development and use?Think - Pair - Share
![Page 3: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/3.jpg)
Sample Project
Comparative Cultural Exhibit Website
SLO Foci:1. Presentational language use2. Cultural comparison3. Career pathway: website and visual design
![Page 4: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/4.jpg)
Sample rubricCriteria Beginning Approaching
ExpectationMeetingExpectation
Exceeding Expectation
Accuracy of language usage
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
Compellingculturalcomparison
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
Appealing website page design
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
![Page 5: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/5.jpg)
What is a rubric?
A rubric is an assessment tool often shaped like a matrix, which describes levels of achievement in a specific area of performance, understanding, or behavior.
From http://manoa.hawaii.edu/assessment/howto/rubrics.htm
![Page 6: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/6.jpg)
A Rubric Matures Over Time
Characteristic Score (1-4)
Accuracy of language usage
Compelling culturalcomparison
Appealing website page design
![Page 7: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/7.jpg)
A Rubric Matures Over TimeCharacteristic Expectations Score
Accuracy of language usage Word choices are appropriate. Almost no grammar errors or typos……
Compelling culturalcomparison
Able to select interesting and culturally significant artifacts. Can describe the similarities and differences of parallel culture artifacts from two cultures, in terms of historical origins, symbolic meaning, and use in social settings…
Appealing website page design
Appealing use of visual art, clear layout, easy navigation…
![Page 8: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/8.jpg)
A Rubric Matures Over TimeCriteria 1 2 3 4
Accuracy of language usage
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
Compellingculturalcomparison
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
Appealing website page design
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
![Page 9: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/9.jpg)
A Rubric Matures Over TimeCriteria Beginning Approaching
ExpectationMeetingExpectation
Exceeding Expectation
Accuracy of language usage
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
Compellingculturalcomparison
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
Appealing website page design
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
[performance descriptors]……
![Page 10: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/10.jpg)
Language Usage Rubric
Intercultural Competency
Rubric
Use of technology and Visual Design
Rubric
Rubrics Mature Over Time
![Page 11: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/11.jpg)
Rubric Development StrategyNo. 1. Learn and AdaptNFLRC Project Design Rubric 2017 as example
![Page 12: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/12.jpg)
Characteristics of a good fully developed rubric:• Clear differentiation between different levels of performance
(4 levels in this case)• Performance descriptors are parallel across different levels• Include important criteria or sub-criteria• No empty descriptions (e.g., poor, good)• Provide resources/examples at the bottom
![Page 13: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/13.jpg)
Adapt well-established rubrics
Language
ACTFL Integrated Performance Assessment
21st Century Skills
BIE Rubrics
AAC&U VALUE Rubrics
AO Rubric Bank
![Page 14: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/14.jpg)
SLOs guide the way
![Page 15: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/15.jpg)
Rubrics chart the water
![Page 16: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/16.jpg)
A good rubricAlign with learning outcomes
Out
com
eComponent skill 1
Component skill 2
Component skill 3
![Page 17: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/17.jpg)
A good rubricAlign with learning outcomes
Com
pare
cul
tura
l di
ffere
nces Linguistic Functions
Culture
Critical Thinking
![Page 18: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/18.jpg)
Linguistic skills:• Appropriate usage of comparative and superlative adjectives
and transitional words and sentence structures…
Culture:• Able to reflect and discuss cultural similarities and differences
in terms of traditions, social behaviors, reactions to value concepts
Critical Thinking:• Able to challenge one’s own assumptions; support opinions
with compelling evidence; evaluate the similarities and differences from multiple angles and perspectives
![Page 19: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/19.jpg)
A good rubricreflect students’ development
Source: screen captures of https://www.youtube.com/watch?v=hqh1MRWZjms
![Page 20: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/20.jpg)
![Page 21: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/21.jpg)
![Page 22: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/22.jpg)
Additional Rubric Development Strategies
• Co-construct with your colleagues• Co-construct with your students• Find similar projects and adapt their rubrics
• Storybook by Don Doehla project design rubric
![Page 23: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/23.jpg)
Review of Rubric Development Strategies• Adapt existing well-established rubrics
• Integrated Performance Assessment by World Language• BIE rubrics, VALUE rubrics, UHM Assessment Office rubric bank
• Align with the outcomes to be assessed• Use student sample work to reflect student development• Co-construct with your colleagues and students• Adapt Rubrics from other classes/projects
![Page 24: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/24.jpg)
Power Use of Rubrics• Give your rubrics out the first day• Ask students to self-assess along the
course• Share annotated exemplary student
work using language from the rubric
![Page 25: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/25.jpg)
Additional Considerations
• Assigning weights for different criteria• Assigning grades
• Holistic• Analytic
• Benchmarking• Judging the success of the project• Use results
![Page 26: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/26.jpg)
Rubric as formative assessmentSLO 1/Criterion 1
1 = Developing2 = Meeting3 = Exceeding
Total SLO 2/Criterion 2NP = No Posting0 = No Comment1 = Developing2 = Meeting3 = Exceeding
Total
M1 M2 M3 M4 M1 M2 M3 M4
Mary
John
![Page 27: Introduction to Rubrics - University of Hawaii...Introduction to Rubrics Yao Zhang Hill, Ph.D. Assessment Office University of Hawai’i at Mānoa Hii, Y. Z., (2017, August). Introduction](https://reader034.vdocuments.us/reader034/viewer/2022042601/5f94300bd50d7e649b707acd/html5/thumbnails/27.jpg)
Next Steps
• Evaluate your rubric• BIE’s Rubric for Rubrics
• Gather feedback from colleagues and students• Pilot the rubric and revise