remediation program successes jeannette guerrasio, md university of colorado 2012
TRANSCRIPT
![Page 1: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/1.jpg)
REMEDIATION PROGRAM SUCCESSES
Jeannette Guerrasio, MDUniversity of Colorado
2012
![Page 2: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/2.jpg)
The presenter
has no disclosures.
Disclosure Information
![Page 3: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/3.jpg)
• Describe the Impact of Struggling Medical Learners
• Identify a Programmatic Approach to a Struggling Learner
• Identification• Diagnosis • Remediation
• Reflect on Program Outcomes
• Plan for the Future through Lessons Learned
Objectives
![Page 4: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/4.jpg)
Magnitude
•Medical Students• Up to 15% struggle during during the clinical years
•Residents• Point prevalence in need of remediation 7-
15%
•Attendings• 17% of physicians were aware of and have
encountered impaired or incompetent colleagues within the past 3 years
Paul G, Teaching and Learning in Medicine. 2009: 21(3):254-60.Yao DC and Wright SM. JAMA 2000; 284;1099-104.
DesRoches CM et al. JAMA 2010; 304(2) 187-193.
![Page 5: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/5.jpg)
Importance
1. Time
2. Morale
3. Reputation
.
Lavin, B et al. Acad Med 1998;73(9):998-1002.
![Page 6: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/6.jpg)
Importance
.
.
![Page 7: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/7.jpg)
• Processes that identified struggling learners:
Direct ObservationCritical IncidentPoor PerformanceNeglecting Patient Care Responsibilities
Identification
Yao, DC & Wright, SM. JAMA. 2000;284:1099-1104.
![Page 8: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/8.jpg)
Identifiers
Formal evaluations of competencies
Written examinations
Clinical performance examinations
Global assessments
During group review or grading session
![Page 9: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/9.jpg)
Identifiers
Formal evaluations of competencies
Written examinations
Clinical performance examinations
Global assessments
During group review or grading session
![Page 10: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/10.jpg)
Identifiers
Verbal comments
Reporting system for concerns
Midterm clinical performance evaluations
![Page 11: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/11.jpg)
Identifiers
Verbal comments
Reporting system for concerns
Midterm clinical performance evaluations
![Page 12: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/12.jpg)
Behavior that is unwanted, but does not interfere significantly with
learning, the physician-patient relationship, or functioning of the health care team.
Minor Lapses
![Page 13: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/13.jpg)
Behavior that is unwanted, and does significantly interfere with learning,
the physician-patient relationship, or functioning of the health care team.
Major Lapses
![Page 14: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/14.jpg)
DEFICIT PRESENTATION
Clinical Reasoning and Judgment
-Have adequate knowledge when asked knowledge-based, fact based questions-Good exam scores-Extraneous information in the H&Ps-Unable to focus history and/or physical-Orders too many tests-Difficulty assigning pre- and post- test probabilities-Difficulty prioritizing their differential diagnosis and analyzing diagnoses-Difficulty individualizing protocols/practice guidelines
EDUCAT I ON
![Page 15: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/15.jpg)
E D U C A T I O N
![Page 16: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/16.jpg)
Accessing Remediation Services
![Page 17: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/17.jpg)
Percentage with deficit
![Page 18: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/18.jpg)
Adapted from Hauer KE et al. Acad Med 2009; 84:1822-1832.
![Page 19: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/19.jpg)
• Medical Knowledge
• Patient Care
• Interpersonal Skills and Communication
• Professionalism
• Practice-Based Learning
• Systems-Based Practice
Competencies:
![Page 20: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/20.jpg)
• Medical Knowledge
• Patient Care• Clinical Skills• Clinical Reasoning• Organization & Time Management
• Interpersonal Skills and Communication
• Professionalism
• Practice-Based Learning
• Systems-Based Practice
Competencies “Plus”:
![Page 21: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/21.jpg)
• Medical Knowledge
• Patient Care• Clinical Skills• Clinical Reasoning• Organization & Time Management
• Interpersonal Skills and Communication
• Professionalism
• Practice-Based Learning
• Systems-Based Practice
• Mental Well-being
Competencies “Plus”:
![Page 22: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/22.jpg)
![Page 23: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/23.jpg)
Why might a reasonable
person
do this?
Adapted from Ledford, CH How to address unprofessional behavior of faculty. Workshop UCD 2009.
![Page 24: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/24.jpg)
Unprofessional behavior in medical school
Subsequent disciplinary action by the state medical board
The Data
Papadakis MA, et al. N Engl J Med 2005; 353:2673-82.Kern DE, et al. Curriculum Development for Medical Education.
2009; p 67.
![Page 25: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/25.jpg)
Unprofessional behavior in medical school
Subsequent disciplinary action by the state medical board
The Data
Papadakis MA, et al. N Engl J Med 2005; 353:2673-82.Kern DE, et al. Curriculum Development for Medical Education.
2009; p 67.
![Page 26: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/26.jpg)
Who Needs to Know?
![Page 27: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/27.jpg)
• Make sure the learner receives the feedback as soon as possible
Problem Identified
Bottom Third
Middle Third
Top Third
-2
-1.5
-1
-0.5
0
0.5
1
Actual Perceived
Z-S
core
Ass
essm
ent
Rel
ativ
e to
Sta
nd
ard
Level of Resident
By Expert AssessmentHodges B Acad Med 2001
![Page 28: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/28.jpg)
Documentation of the Problem With examples
Committee Decision Making
Warning, Focused Review and Probation
When to Notifying Evaluating Faculty
Know Your Resources
Policies and Procedures
Problem Identified
![Page 29: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/29.jpg)
• The goal of remediation is to target and fix the greatest deficit!• Choose ONE problem with the greatest
return for the efforts• If mental well-being or professionalism
deficiency, consider starting there!
Remediation Strategy
![Page 30: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/30.jpg)
• Limits: • Methods are not standardized • Paucity of data on reliable, valid,
practical assessment tools• Few small, single institution studies on
remediation• Lack of evidence to guide best
practices in remediation
Remediation
![Page 31: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/31.jpg)
Adapted from Hauer KE et al. Acad Med 2009; 84:1822-1832.
![Page 32: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/32.jpg)
1. Deliberate Practice
2. Receive Feedback
3. Reflection in Action
Remediation Strategy
![Page 33: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/33.jpg)
• Deliberate Practice• Review remediation plan• Review Cases
• Highlighter Method • Create a Chart
Clinical Reasoning
Rhinorrhea Wheezing Unilateral crackles
Fever No edema
Pna
CHF
Etc.
Blankenburg R. et al.. PAS May 2011.
![Page 34: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/34.jpg)
• Deliberate Practice Continued• Framework for creating a ddx• Create ddx: age, gender, race/ethnicity,
and cc
Clinical Reasoning
Presenting Symptom: Chest Pain
Symptoms and historical info.
Signs Data Presenting Symptom: Chest Pain
Symptoms and historical info.
GERD Subacute, epigastric, burning, supine, relief with antacids
Tenderness to palpation of the epigastrium
Abnormal EGD
GERD Subacute, epigastric, burning, supine, relief with antacids
Stable Angina Male, pressure with radiation to arm or jaw, exertional, +/-SOB, nausea, DM, HTN, HLD, tobacco, FmHx
May have murmur, lateral PMI, gallop, paradox split S2, or normal
Abnormal EKG, Dynamic EKG
Stable Angina
Male, pressure with radiation to arm or jaw, exertional, +/-SOB, nausea, DM, HTN, HLD, tobacco, FmHx
Etc. Etc.
![Page 35: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/35.jpg)
• Deliberate Practice Continued• Collect H&P• Create a problem list and reorganize the ddx.• COMPARE AND CONTRAST!• Framework for choosing the diagnostic plan and
treatment
• Receiving Feedback• Re-enforce the use of resources and seniors or
consultants for feedback
Clinical Reasoning
![Page 36: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/36.jpg)
• Reflection in Action• SNAPPS
• S- summarize history and findings, • N- narrow the differential to 2-3 most likely, • A-analyze the differential by comparing and
contrasting, • P-plan treatment and further work-up, • P-probe the preceptor about uncertainties
and alternatives, • S-select an issue related to the care for self-
directed learning.
Clinical Reasoning
Wolpaw TM et al. Acad Med 2003;78(9):893-8.
![Page 37: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/37.jpg)
• Deliberate Practice • Review the remediation plan
• Set strict behavioral guidelines, including what is not acceptable behavior
• Review examples: perspectives and perceptions, and future suggestions
• Have the learner identify a role model that they would like to emulate
• Mental health evaluation/referral with drug testing
• Receiving Feedback• Discuss academic and career consequences
• Increased supervision with feedback
• Reflection in Action• Insight is essential! Ask them to write.
Professionalism
![Page 38: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/38.jpg)
Adapted from Hauer KE et al. Acad Med 2009; 84:1822-1832.
![Page 39: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/39.jpg)
• Define Success:
1. Has the individual showed significant improvement and caught up to his or her level of training in the previously deficient competency?
2. Is the improvement sustainable?
Measuring Success
![Page 40: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/40.jpg)
Reassessment
• Repeat exposure• Standardized
patient & simulation• Directly observed
encounters• Written or web-
based assessments• Chart reviews &
chart-stimulated recall
• Patient and procedure logs
• Multisource evaluations
• Arrival and Departure Times
• Attendance
• Attire
• Responses to self-assessment
![Page 41: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/41.jpg)
COMPETENCY REASSESSMENT OPTIONS
Medical Knowledge Written or web-based knowledge assessmentsMultiple choice exams
Clinical Skills Observed structured clinical examinations (OSCE) Standardized patient encounters/Simulation Repeating part or all of a rotationProcedure logs
Clinical Reasoning Written or web-based case-based assessmentsStandardized patient encounters or OSCE Mini-clinical evaluation examinationsChart-stimulated recallRepeating part or all of a rotation
Organization and Time Management
Direct observation Repeating part or all of a rotationMulti-source evaluationsPatient and Procedure logs
Interpersonal Skills Direct observationStandardized patient encounters or OSCE Mini-clinical evaluation examinationsMulti-source evaluationsResponses to self-reflection
![Page 42: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/42.jpg)
COMPETENCY REASSESSMENT OPTIONS
Communication Direct observationStandardized patient encounters or OSCE Mini-clinical evaluation examinationsMulti-source evaluations
Professionalism Direct observationMulti-source evaluationsResponses to self-reflectionPatient and procedure logs
Practice-Based Learning and Improvement
Responses to self-reflectionEvaluation from supervisorsCritique of journal articles
Systems-Based Practice
Direct observationMulti-source evaluations
Mental Well-being Direct observationEvaluations from supervisorsRepeat part or all of a rotationPsychiatric evaluation, fitness for duty
![Page 43: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/43.jpg)
• Let’s talk...
![Page 44: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/44.jpg)
“This learner should never be a doctor”
• Passed the rotation
![Page 45: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/45.jpg)
![Page 46: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/46.jpg)
Planning for the Future
• Dissemination and sharing of ideas
• Publish methods
• Publish more specific outcomes
• Reproduce at other institutions
• Disseminate program
![Page 47: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/47.jpg)
• Challenge of struggling learners exist in all programs
• IDENTIFY• DIAGNOSE• REMEDIATE with
• DELIBERATE PRACTICE• FEEDBACK• REFLECTION IN ACTION
• Measure and document your remediation efforts
• Share your results
Summary
![Page 48: REMEDIATION PROGRAM SUCCESSES Jeannette Guerrasio, MD University of Colorado 2012](https://reader037.vdocuments.us/reader037/viewer/2022110100/56649dde5503460f94ad76d1/html5/thumbnails/48.jpg)
Contact Information
• www.clinicalremediation.com