you be the judge…
DESCRIPTION
You Be the Judge…. View the following performances In small groups, take 1 minute to assign a score from 1-10 using any means. Be prepared to share your reasoning…. How Did It Go?. What did you notice?. Resident Evaluation. Shawn Alderman, MD Faculty Development Fellow. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/1.jpg)
![Page 2: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/2.jpg)
You Be the Judge…
View the following performances
In small groups, take 1 minute to
assign a score from 1-10 using any means.
Be prepared to share your reasoning…
![Page 3: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/3.jpg)
![Page 4: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/4.jpg)
![Page 5: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/5.jpg)
![Page 6: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/6.jpg)
How Did It Go?
What did you notice?
![Page 7: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/7.jpg)
Resident Evaluation
Shawn Alderman, MD
Faculty Development Fellow
![Page 8: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/8.jpg)
Learning Objectives
• Examined why we evaluate
• Identified essentials of evaluations
• Listed common skills to assess
• Reviewed available evaluation tools
• Recognized potential pitfalls and biases
![Page 9: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/9.jpg)
Take Home Points…
• Evaluations are azimuth checks
• Assess specific skills
• Incorporate standards
• Use your tool box
• Be aware of our personal biases
• Departmental communication is essential
![Page 10: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/10.jpg)
Activity One
• Why are evaluations important?
• What problems have you encountered?
![Page 11: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/11.jpg)
Stakeholders
![Page 12: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/12.jpg)
Types of Evaluations
• Formative
• Summative
![Page 13: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/13.jpg)
Activity Two
With the End in Mind
In your groups, discuss the things you consider before writing a learner’s evaluation
![Page 14: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/14.jpg)
The Standard
![Page 15: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/15.jpg)
A Standard is…
• …the yardstick
• …the bare minimum requirement
• …a requirement that must be met
• …a minimum skill set
![Page 16: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/16.jpg)
Standards Must Be
![Page 17: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/17.jpg)
Evaluation Essentials
• Formal - standardized, routine, expected
• Communication – dialogue, frequency
• Documentation - summative, written signed
• Due Process - standards, plans, consequences
![Page 18: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/18.jpg)
Skill Evaluation
![Page 19: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/19.jpg)
Activity Three
In your groups, discuss the skill sets and put them in a ranked order from highest to
lowest in importance
![Page 20: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/20.jpg)
The Tool Box…
• Checklists
• Rating Scales
• Anecdotal Records
• Incident Reports
• RIME Method
• BSQs
• Global Assessments
• OSCEs
• Simulation
• Examinations
• Video Clinic
• 360 Degree Evals
![Page 21: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/21.jpg)
Is the tool sharp?
• Use the right tool
• Inspect the tool
• Tool improvement
![Page 22: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/22.jpg)
Activity Four
In your groups, review the evaluation tools.
How would you improve the tool?
![Page 23: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/23.jpg)
Activity Five
In groups, match the error or bias type with the
appropriate description
![Page 24: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/24.jpg)
Avoiding Error and Bias
• Know thyself
• Consult colleagues
• Use multiple tools
• Faculty development
![Page 25: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/25.jpg)
Recent Incident Bias: Bias because of an isolated recent incident…
Central Tendency: Sitting on the fence …
Extreme Response Bias: Respondents tend to mark extremes …
Affirmation/Yea-Saying Bias: Give positive responses irrespective …
Incompetence Bias: Assign high ratings because of lack of confidence…
Leniency Bias: Being overly charitable
Halo Effect: Overall impression of a person affect rating on each item…
Contrast Bias: Rating against another person's performance…
Stringency Bias: Being overly critical
![Page 26: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/26.jpg)
Our Evaluation System
•Standard focused
•Assessing skills
•Using all tools
•Minimizing error/bias
•Communicating
![Page 27: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/27.jpg)
Commitment
• What are our areas of weakness?
• How can we improve our evaluation process?
• When will we start?
![Page 28: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/28.jpg)
Take Home Points…
• Evaluations are azimuth checks
• Assess specific skills
• Incorporate standards
• Use your tool box
• Be aware of our personal biases
• Departmental communication is essential
![Page 29: You Be the Judge…](https://reader035.vdocuments.us/reader035/viewer/2022062309/56815202550346895dc04328/html5/thumbnails/29.jpg)