using rubrics as assessment instruments · a sample analytic rubric 1 emerging’skill 2...

16
Using Rubrics as Assessment Instruments Cincinnati State Common Time December 3, 2018

Upload: others

Post on 09-Oct-2019

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Using Rubrics as Assessment InstrumentsCincinnati State Common Time

December 3, 2018

Page 2: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Why use rubrics?

• To communicate expectations clearly to students

• To provide structure for discussion of performance

• To examine how well students have met learning outcomes, rather than performance compared to peers

• To track performance against benchmarks

Page 3: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Starting from Learning Outcomes

Goal

Competency

Learning Outcome

Page 4: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Starting from Learning Outcomes

Goal: Birthday Observation

Competency: Spouse will be able to appropriately observe a birthday

Learning Outcome: Spouse will produce* a classic birthday breakfast-in-bed

*Bloom’s synthesis-level verb

Page 5: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

A Brief Digression on Verbs

Student Learning Outcomes

Students should be able to <action verb> <something>.

Page 6: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

A Brief Digression on Verbs

In order to be assessable the verb should point to a Performance Level in Bloom’s Taxonomy

Knowledge: define, identify, list, name, quote. . .

Comprehension: compare, discuss explain, predict. . .

Application: calculate, demonstrate, operate, solve. . .

Analysis: analyze, classify, diagram, summarize. . .

Synthesis: compose, construct, formulate. . . produce*.. .

Evaluation: appraise, determine, evaluate, recommend. . .

Page 7: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Starting from Learning Outcomes

Learning Outcome

PerformanceIndicator

#1

PerformanceIndicator

#2

PerformanceIndicator

#3

Page 8: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Starting from Learning Outcomes

Learning Outcome: Spouse will produce a classic birthday breakfast-in-bed

Cooking Presentation Comportment

Page 9: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Rubric Types

Holistic

Evaluates all performance indicators simultaneously to createa single score or grade

Analytic

Evaluates each performance indicator

(dimension) individually to create

separate scores for each performance indicators

Page 10: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

A Sample Holistic RubricLearning Outcome: Spouse will serve a classic birthday breakfast-in-bed

Cooking Presentation Comportment

Score Point

Description

1Emerging Skills

An attempt at preparation of hot food is present but contains major flaws affecting edibility of some items;; Presentation is messy, disturbing, or missing key usability features such as napkin or utensils;; Comportment is deficient including sullen, harried or resentful behaviors.

2Developing Skills

Edible food has been cooked, but contains minor flaws affecting enjoyment, such as over/under-­cooking or sub-­optimal temperature at time of serving. Presentation resembles competent home-­cooking and includes all necessary utensils and condiments, but lacks sense of artistry or special care. Comportment of server is pleasant but shows some signs of discomfort, distress, or discontent.

3Proficient in Skills

All food is properly prepared, edible, and enjoyable. Breakfast is recognizable as fully competent home-­cooking, but would not be mistaken for professional cooking. Presentation contains evidence that care has been taken to look better than “everyday” breakfast. Server might have anticipated needs or desires beyond basic utensils and condiments. Comportment is cheerful with no signs of distress or resentment.

4Mastery of Skills

Food is flawlessly prepared and indistinguishable from what one might expect in a fine restaurant. Presentation exhibits artistry and flair, might be beautiful enough to present slight sadness at the thought of disturbing the service. Server appears fully committed to both parties’ enjoyment of the experience, might appear to be taking more pleasure in the experience than the recipient.

Page 11: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

A Sample Analytic Rubric1

Emerging Skill2

Developing Skill3

Proficient in Skill4

Mastery of SkillScore

Cooking(dimension)

An attempt at preparation of hot food is present but contains major flaws affecting edibility of some items

Edible food has been cooked, contains minor flaws affecting enjoyment, such as over/under-­cooking or sub-­optimal temperature at time of serving.

All food is properly prepared, edible, and enjoyable. Breakfast is recognizable as fully competent home-­cooking, but would not be mistaken for professional cooking.

Food is flawlessly prepared and indistinguishable from what one might expect in a fine restaurant.

Presentation(dimension)

Presentation is messy, disturbing, or missing key usability features such as napkin or utensils

Presentation resembles competent home-­cooking and includes all necessary utensils and condiments, but lacks sense of artistry or special care.

Presentation contains evidence that care has been taken to look better than “everyday” breakfast. Server might have anticipated needs or desires beyond basic utensils and condiments.

Presentation exhibits artistry and flair, might be beautiful enough to present slight sadness at the thought of disturbing the service.

Comportment(dimension)

Comportment of server is deficient, including sullen, harried or resentful behaviors.

Comportment of server is pleasant but shows some signs of discomfort, distress, or discontent.

Comportment is cheerful with no signs of distress or resentment.

Server appears fully committed to both parties’ enjoyment of the experience, might appear to be taking more pleasure in the experience than the recipient.

Total Score

Classic Breakfast-in-Bed Rubric (domain)

Page 12: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Advantages and DisadvantagesHolistic

+ Fast scoring

+ Easier to achieve inter-rater reliability

+ Summative

‾ Does not provide granular feedback on where improvement

is needed

‾ Formative

Page 13: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Advantages and DisadvantagesAnalytic

+ Diagnostic

+ Easy connection to assignment instructions

+ Granular feedback

+ Formative

‾ Slow scoring

‾ More difficult to achieve inter-rater

reliability

Page 14: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Other Types of Rubrics

Interactive ChecklistYes No

CookingWas all food edible?Was all food served at an acceptable temperature?PresentationWas food presented attractively?Were all necessary utensils present?ComportmentWas the server congenial and relaxed?Was breakfast-­in-­bed a pleasant experience?

Page 15: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)

Other Types of Rubrics

Rating Scale

Classic Breakfast in Bed1

BelowExpectations

2Meets

Expectations

3Exceeds

ExpectationsComments

Food preparationPresentation

Server Comportment

Page 16: Using Rubrics as Assessment Instruments · A Sample Analytic Rubric 1 Emerging’Skill 2 Developing’Skill 3 Proficient’in’Skill 4 Mastery’ofSkill Score Cooking (dimension)