evaluation mechanisms for the osumc radiology … · evaluation mechanisms for the osumc radiology...

41
Evaluation Mechanisms for the OSUMC Radiology Residency Curriculum Evaluating resident’s knowledge, skills, and performance is continually done to ensure that the objectives and standards listed in the Rotation Descriptions and Duty Sheets are met. Evaluation mechanisms in use by the program are consistent with those described in "Competencies Definitions and Practice Performance Measurements from the RRC for Diagnostic Radiology" Evaluation Method Codes In the individual Rotation Descriptions contained in the Radiology Residency Curriculum Description, letter codes have been used to indicate which evaluation mechanisms are most commonly applied to any given set of objectives. This simplifies the Rotation Descriptions to make it easier to find important information about competencies, goals, and objectives. These Evaluation Method Codes should be interpreted with the following considerations in mind: The same code for two different groups of objectives, within the same rotation or between different rotations, does not necessarily mean that the evaluation process will be identical. For example, an "objective test" can be written, or can be administered as an oral exam. It may occur at the end of the year, or at the end of one month of a rotation. Each evaluation activity will be adapted to the content of the rotation and the experience level of the resident. There is no one-to-one correspondence, in terms of timing, between the evaluation methods indicated by the letter codes and the objectives to which they are attached. Some methods are applied on a yearly basis, covering several rotations, while others are applied at the end of one month of a rotation (even if the complete rotation requires more than one month's experience). Some evaluation mechanisms tend to be "nested" under others. For example, Direct Observation (D) and Evaluation of Quality of Reports (C) are considered when faculty perform Global Evaluations (A) of residents. The Code List The letter codes used in the Rotation Descriptions are listed below, with brief descriptions of the activities involved: A. Global Evaluation of Residents by Faculty. Faculty indicate whether the resident is below, at, or above expected competency levels for each of the goals, attached to the six competency areas, that are common to all rotations in the department. This form is completed monthly, on New Innovations. B. 360 Degree Evaluations. 360 degree Feedback is collected on each resident either annual or biannual. This feedback is "global", that is, it is not tied to specific rotations or subspecialties. C. Evaluation of quality of reports. Quality of reports is monitored throughout each rotation, and the supervising faculty incorporates their observations into the Global Evaluation of Residents (A). D. Direct Observation or OSCE. Direct observation of critical procedures and processes is most commonly part of the ongoing activity in a rotation, and supervising faculty incorporate their observations into the Global Evaluation of Residents (A). 1

Upload: phamtruc

Post on 22-Jun-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

Evaluation Mechanisms for the OSUMC Radiology Residency Curriculum

Evaluating resident’s knowledge, skills, and performance is continually done to ensure that the objectives and standards listed in the Rotation Descriptions and Duty Sheets are met. Evaluation mechanisms in use by the program are consistent with those described in "Competencies Definitions and Practice Performance Measurements from the RRC for Diagnostic Radiology"

Evaluation Method Codes

In the individual Rotation Descriptions contained in the Radiology Residency Curriculum Description, letter codes have been used to indicate which evaluation mechanisms are most commonly applied to any given set of objectives. This simplifies the Rotation Descriptions to make it easier to find important information about competencies, goals, and objectives.

These Evaluation Method Codes should be interpreted with the following considerations in mind:

• The same code for two different groups of objectives, within the same rotation or between differentrotations, does not necessarily mean that the evaluation process will be identical. For example, an"objective test" can be written, or can be administered as an oral exam. It may occur at the end of theyear, or at the end of one month of a rotation. Each evaluation activity will be adapted to the content ofthe rotation and the experience level of the resident.

• There is no one-to-one correspondence, in terms of timing, between the evaluation methods indicatedby the letter codes and the objectives to which they are attached. Some methods are applied on a yearlybasis, covering several rotations, while others are applied at the end of one month of a rotation (even ifthe complete rotation requires more than one month's experience).

• Some evaluation mechanisms tend to be "nested" under others. For example, Direct Observation (D)and Evaluation of Quality of Reports (C) are considered when faculty perform Global Evaluations (A) ofresidents.

The Code List

The letter codes used in the Rotation Descriptions are listed below, with brief descriptions of the activities involved:

A. Global Evaluation of Residents by Faculty. Faculty indicate whether the resident is below, at, orabove expected competency levels for each of the goals, attached to the six competency areas, that arecommon to all rotations in the department. This form is completed monthly, on New Innovations.

B. 360 Degree Evaluations. 360 degree Feedback is collected on each resident either annual or biannual.This feedback is "global", that is, it is not tied to specific rotations or subspecialties.

C. Evaluation of quality of reports. Quality of reports is monitored throughout each rotation, and thesupervising faculty incorporates their observations into the Global Evaluation of Residents (A).

D. Direct Observation or OSCE. Direct observation of critical procedures and processes is mostcommonly part of the ongoing activity in a rotation, and supervising faculty incorporate their observationsinto the Global Evaluation of Residents (A).

1

E. Resident Learning Portfolio. Documentation of resident participation in conferences and courses, aswell as any self-assessment modules that may be completed.

F. Case/Procedure Logs. Case logs are reviewed on a yearly basis. Logs meet the requirements forvascular and interventional procedures. Residents are also responsible for keeping a case log book fornuclear medicine therapies. Case logs for other areas are in the process of development.

G. Objective Tests. Objective tests may be written or oral. Among department activities in this area aremonthly objective tests at the end of some rotations, Rad Primer routine tests, participation in the ACRIn-Service Test, and mock oral boards given in winter of the 4th year of residency. Resident performanceon the Physics, Writtens and Oral boards by the AOBR are also documented during residency.

H. Journal Club. Journal Club is a monthly activity which gives residents an opportunity to demonstratetheir ability to access, interpret, and apply the radiology literature to enhance their skills and knowledge,and to improve the quality of patient care.

I. Documentation of Participation in Hospital and Departmental Activities. Graduate MedicalEducation Committee (Chief Resident), Radiology Department meetings (required), Medical Staffmeetings (required) and other hospital committees (residents required to be a part of 1 hospital committeefor the academic year) are among the many activities residents are involved.

2

ItemizedListofEvaluationsincludedandusedorareintheprocessofbeingimplementedreplacingpastevaluations.

Page4:ResidentEvaluationbyFaculty

Page6:ResidentEvaluationbyTechnologist/Ultrasonographer/Nurse

Page7:ResidentEvaluationbyPeer

Page9:ResidentEvaluationbyPatient

Page10:ResidentSelfEvaluation

Page12:ResidentPortfolio

Page21:AOCRAnnualProgramDirector’sAnnualResidentEvaluation

Page24:AOCRProgram“Complete”Summary–FinalResidentAssessment

Page25:FacultyEvaluationbyResident

Page27:AnnualProgramEvaluationbyResident

Page28:ProgramEvaluationbyFaculty

Page29:RadiologyMilestones

3

OSUMC Radiology Resident Formative Evaluation by Faculty

Evaluator: __________________________________________________

Rotation: ___________________________________________________

This formative evaluation form is an important component of assessing the program's educational effectiveness and the resident's educational progress. Please indicate your evaluation rating of the resident's performance during this one month rotation with respect to the established rotation goals and objectives as they apply to the resident's individual level of training.

PATIENT CARE

(Resident should provide compassionate, and effective care for health problems)

1) Develops a management plan based on radiologic findings and clinical information.

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

2) Demonstrates proper technique in planning and performing image-guided procedures

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

3) Appropriately obtains informed consent

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

MEDICAL KNOWLEDGE and CLINICAL PERFORMANCE

(Resident should be knowledgeable, scholarly, and committed to lifetime learning)

4) Recognizes and describes relevant radiologic abnormalities

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

5) Synthesizes radiologic and clinical information and forms a diagnostic impression

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

6) Utilizes information technology to investigate clinical questions and for continuous self-learning

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

INTERPERSONAL/COMMUNICATION SKILLS

(Resident should communicate and teach effectively)

7) Shows sensitivity to and communicates effectively with all members of the health care team

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

8) Recognizes, communicates, and documents in the patient record urgent or unexpected radiologic findings

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

9) Produces radiologic reports that are accurate, concise, and grammatically correct

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

10) Effectively teaches residents, medical students and other health care professionals

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

4

PRACTICE-BASED LEARNING AND IMPROVEMENT

(Resident should investigate and evaluate patient care practices, appraise & assimilate scientific evidence in order to improve practices)

11) Recognizes and corrects personal errors

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

12) Accepts constructive criticism

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

PROFESSIONALISM

(Resident should be altruistic and accountable, and adhere to principles of medical ethics by respecting and protecting patients' best interests)

13) Demonstrates a responsible work ethic with regard to attendance and work assignments.

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

14) Demonstrates acceptable personal demeanor and hygiene.

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

15) Demonstrates responsible handling of patient medical record confidentiality

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

SYSTEMS-BASED PRACTICE

(Residents should understand healthcare practices)

16) Applies appropriateness criteria and other cost-effective healthcare principles to professional practice.

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

17) Demonstrates diligence in following hospital/department procedures and policies

Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

GENERAL

Please provide comments regarding the resident's overall behavior: _______________________________________

This resident has effectively met the required goals and objectives of the month's rotation as described in the

educational curriculum. (If not, please elaborate in the comment field.)

Yes______________________________________________ No____________________________________________

Comments: ______________________________________________________________________________________

If you feel comfortable, please discuss the above with the resident. Both the positive and negative.

I have discussed this evaluation with the resident. (Please indicate date in comment field)

Yes_________No ______N/A__________

5

OSUMC Radiology Resident Evaluation by: (please circle one below)

Technologist Ultrasonographer Nurse

Resident Name:

For each category circle a number (1-9) that you feel is appropriate.

Clinical Knowledge: Residents should be able to explain procedures to patients in a knowledgeable fashion. Should be aware of the reason for the procedure and the clinical condition of the patient. Knowledge is consistent with level of training and has progressed since previous rotation.

Is aware of the patient’s clinical condition, indications for possible outcomes and complications. 9 8 7

Understands the indication for examination and expected outcome and complications. 6 5 4

Unsure of reason for performing examination or possible complications. 3 2 1

Technical knowledge: Evaluation based on knowledge of procedure, machines, scanning parameters, filming, and PACS functions (pertinent to the modality you are in). Residents should be aware of radiation protection techniques including use of, collimation and appropriate reduction in fluoroscopy time to protect patient and physician.

Shows a very thorough understanding of technical concepts. Can optimize more detailed technical settings. 9 8 7

Selects and utilizes material and equipment correctly. Can use the technology/machines needed, i.e. ultrasound units, fluoroscopy units, CT 6 5 4

Needs to improve knowledge of techniques. 3 2 1

Patient Care: Resident interaction with patients.

Excellent bedside manner. Receives positive feedback from patients. 9 8 7

Good with patients. 6 5 4

Inappropriate with patients. Receives negative comments from patients. 3 2 1

Interpersonal/Communication Skills: Refers to ability to interact well with other members of the patient care team.

Performs duties conscientiously and enthusiastically. Reports where and when scheduled. Works well with the technologists. 9 8 7

Performs duties willingly and without complaint. Generally works well with others. 6 5 4

Avoids duties and/or complains often. Often “disappears”. 3 2 1

Comments will be very much appreciated. Comments are mandatory if an unsatisfactory evaluation of 1 or 2 is given.

Comments:

Signature: Date:

6

Evaluation of Resident Performance by Peer

Evaluator:

Subject:

Credentials: Radiology Resident

Please consider the following statements while rating this Resident. Base your ratings on your personal observations.

PATIENT CARE - Resident should provide patient care through safe, efficient, appropriately utilized, quality-controlled radiology techniques and effectively communicates results to the referring physician and/or other appropriate individuals in a timely manner

1. Develops a management plan based on radiologic findings and clinical information♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

2. Is helpful in orienting lower level residents new to the service or hospital♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

3. Demonstrates sensitivity to a patient's cultural/social/economic issues. ♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

4. Demonstrates strong sense of patient ownership and accountability. ♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

MEDICAL KNOWLEDGE - Resident should engage in continuous learning and apply appropriate state of the art diagnostic and/or interventional radiology techniques to meet the imaging needs of patients, referring physicians and the health care system

1. Recognizes and describes relevant radiologic abnormalities♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

2. Is available to and takes time to teach lower level residents when working together♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

3. Utilizes information technology to investigate clinical questions and for self-learning♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

4. Performs procedures effectively.♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

INTERPERSONAL/COMMUNICATION SKILLS - Resident should communicate effectively with patients, colleagues, referring physicians and other members of the health care team concerning imaging appropriateness, informed consent, safety issues and imaging results

1. Shows sensitivity & communicates effectively with all members of the health care team♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

2. Effectively teaches non-radiology residents, students and other health care professionals♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

3. Takes time to explain to lower level residents how to dictate reports♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

PRACTICE-BASED LEARNING AND IMPROVEMENT - Resident should participate in evaluation of one's personal practice utilizing scientific evidence, "Best practices" and self-assessment programs in order to optimize patient care through lifelong learning

1. Participates in Journal Club, Morbidity and Mortality, Interesting Case Conferences or QI/QA activities♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

2. Appropriately accepts constructive criticism Without taking it personally and attempts to make improvements♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

3. Is insightful into own character, being able to recognize personal errors and correct them♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

7

PROFESSIONALISM - Resident should commit to high standards of professional conduct, demonstrating altruism, compassion, honesty and integrity, follows principles of ethics and confidentiality, and considers religious, ethnic, gender, educational and other differences when interacting with patients and other members of the health care team

1. Demonstrates a responsible work ethic including showing up on time and not leaving until the work is finished ♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

2. Is willing to take a turn to help out when needed including being willing to switch rotations or take call if needed to cover for the other

residents ♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

3. Works professionally alongside other residents and faculty w/o complaining or gossiping

♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

4. Manages personal stress effectively. ♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

SYSTEMS-BASED PRACTICE - Resident should understand how the components of the local and national healthcare system functions interdependently and how changes to improve the system involve group and individual efforts

1. Dedicates time to study effectively, looks up answers to questions raised daily ♦ Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

OVERALL PERFORMANCE How would you rate this resident overall as someone you would like to work with?

8

PATIENT CARE SURVEY

Please take a moment to evaluate the following OSUMC radiology resident.

PHYSICAN NAME: _______________________________________________________________

Overall satisfaction (circle one; 1=very poor, 10=excellent):

1 2 3 4 5 6 7 8 9 10

Circle below Yes or No to the questions:

Introduced him/herself to you and your family: YES OR NO

Was polite and considerate at all times: YES OR NO

Was dressed professionally (clean, tidy, “business-like”): YES OR NO

Behaved appropriately: YES OR NO

Listened carefully to your concerns and questions: YES OR NO

Explained risks and benefits of the procedure in a clear fashion: YES OR NO

Discussed results of procedure to your satisfaction: YES OR NO

Gave good, clear, accurate instructions for post-clinic care: YES OR NO

9

OSUMC Radiology Resident Self Evaluations

Instructions for Self Evaluations

1. In keeping with the ACGME Milestones initiative this evaluation rates residents on continuum of achievement.2. Please select the appropriate level of achievement for yourself as resident:

Level 1: I demonstrate milestones expected of one who has had some education in diagnostic radiology. Level 2: I am advancing and demonstrate additional milestones. Level 3: I continue to advance and demonstrate additional milestones; I consistently demonstrate the majority of milestones targeted for residency. Level 4: I have advanced so that I now substantially demonstrate the milestones targeted for residency. This level is designed as the graduation target. Level 5: I have advanced beyond performance targets set for residency and I am demonstrating “aspirational” goals which might describe the performance of someone who has been in practice for several years. It is expected that only a few exceptional residents will reach this level.

Patient Care & Technical Skills - Milestones

PCTS 1: Consultant __Level 1: Uses evidence-based imaging guidelines. Appropriately uses the medical record to obtain patient information. __Level 2: Recommends appropriate imaging of common conditions. __Level 3: Recommends appropriate imaging of uncommon conditions. __Level 4: Integrates current research and literature with guidelines to recommend imaging. __Level 5: Participates in research, development, and implementation of imaging guidelines.

PCTS 2: Competence in Procedures 1 __Level 1: Competently performs basic procedures with minimal attending intervention. __Level 2: Competently performs intermediate procedures with minimal attending intervention. __Level 3: Competently performs advanced procedures with minimal attending intervention.

PCTS 3: Competence in Procedures 2 __Level 1: Recognizes and manages complications of basic procedures. __Level 2: Recognizes and manages complications of intermediate procedures. __Level 3: Recognizes and manages complications of advanced procedures.

Medical Knowledge – Milestones

MK1: Protocol selection and optimization of images __Level 1: Selects appropriate protocols for basic imaging, including on-call protocols. __Level 2: Selects appropriate protocols for intermediate imaging. __Level 3: Selects appropriate protocols for advanced imaging. Demonstrates knowledge of physical principles to optimize image quality. __Level 4: Independently modifies protocols as determined by clinical circumstances. Applies physical principles to optimize image quality. __Level 5: Teaches and/or writes imaging protocols.

MK2: Interpretation of examinations __Level 1: Makes core observations, formulates differential diagnoses, and recognizes critical findings. Differentiates normal from abnormal. __Level 2: Makes secondary observations, narrows the differential diagnosis, and describes management options. __Level 3: Provides accurate, focused, and efficient interpretations. Prioritizes differential diagnoses and recommends management. __Level 4: Makes subtle observations. Suggests a single diagnosis when appropriate. Integrates current research and literature with guidelines to recommend management. __Level 5: Demonstrates expertise and efficiency at a level expected of a subspecialist. Advances the art and science of image interpretation.

Professionalism – Milestones

PROF1: Professional Values and Ethics __Level 1: Demonstrates professional behavior. __Level 2: Is an effective health care team member. __Level 3: Is an effective heath care team leader. __Level 4: Serves as a role model for professional behavior. __Level 5: Participates in local and national organizations to advance professionalism in radiology. Mentors others regarding professionalism and ethics.

Interpersonal and Communications Skills – Milestones

ICS1: Effective communication with patients, families and caregivers. __Level 1: Communicates information in routine, uncomplicated circumstances. Obtains informed consent. __Level 2: Communicates under direct supervision, in challenging circumstances, difficult information. __Level 3: Communicates under indirect supervision, in challenging circumstances, difficult information. __Level 4: Independently communicates complex and difficult information, such as errors, complications, adverse events, and bad news.

10

__Level 5: Serves as a role model for effective and compassionate communication. Develops patient-centered educational materials.

ICS2: Effective communication with members of the health care team: Written/Electronic __Level 1: Generates accurate reports with appropriate elements required for coding. __Level 2: Efficiently generates clear and concise reports that do not require substantive faculty member correction on routine cases. __Level 3: Efficiently generates clear and concise reports that do not require substantive faculty member correction on complex cases. __Level 4: Efficiently generates clear and concise reports that do not require substantive faculty member correction on all cases. __Level 5: Generates tailored reports meeting needs of referring physician. Develops templates and report formats.

ICS2: Effective communication with members of the health care team: Verbal __Level 1: Communicates urgent and unexpected findings according to institutional policy and ACR guidelines. __Level 2: Communicates findings and recommendations clearly and concisely. __Level 3: Communicates appropriately under stressful situations. __Level 4: Communicates effectively and professionally in all circumstances. __Level 5: Leads interdisciplinary conferences. Serves as a role model for effective communication.

Practice-Based Learning and Improvement – Milestones

PBLI1: Radiation Safety __Level 1: Describes the mechanisms of radiation injury and the ALARA concept. __Level 2: Accesses resources to determine exam-specific average radiation dose information. __Level 3: Communicates the relative risk of exam-specific radiation exposure to patients and practitioners. __Level 4: Applies principles of Image Gently and Image Wisely. __Level 5: Promotes radiation safety.

11

OSUMC DIAGNOSTIC RADIOLOGY

BIANNUAL RESIDENT PORTFOLIO – SELF EVALUATION AND REFLECTION REVIEW

Dates (time period for review):___________________

Date of evaluation/review with resident: ________________ PGY 1 2 3 4 5

Resident name: ______________________

For reviewer use only:

Overall assessment of progress:

__ Beginning (partial demonstration of required and non-required exhibits)

__ Advancing (substantial demonstration of required and non-required exhibits)

__ Competent (satisfactory demonstration of required and non-required exhibits)

__ Above Competence (outstanding demonstration of required and non-required exhibits)

Deficiencies (if applicable):

Plan of action:

Follow up activity/meeting required in the following areas:

Item(s) required to do/Deadline Date/Sign off date:

1.

2.

3.

4.

Program Director signature: ________________________________

Resident signature following review after discussion with Program Director:

_________________________________________

12

MEDICAL KNOWLEDGE

Reflect on this academic period: List 2 or 3 things you wish you would have known before this academic period. List information which you have learned that you think will be most helpful to the class of residents immediately below you.

1. ___________________________________________

2. ___________________________________________

3. ___________________________________________

Conference attendance this period: _____% Goal:_____%

Milestone Assessment: At level of training for all _________ Need to work on _________

Comments about Milestone Assessment:

ACR In-Training and/or Written exam:

Strengths: ________________________

Weaknesses: ________________________

Goal: ________________________

Plan to reach goal: ____________________

Took USMLE part 3? Yes ___ No ___ Passed or Failed (circle one)

Took COMPLEX part 3? Yes ___ No ___ Passed or Failed (circle one)

Took AOBR physics exam? Yes ___ No ___ Passed or Failed (circle one)

Took AOBR writtens exam? Yes ___ No ___ Passed or Failed (circle one)

Are there any exams you plan to take in the next 12 months? _______________

Performance on routine Rad Primer curriculum exams in last 6 month period:

Infrequently pass rate (<25%): _____

Below average pass rate (25-50%): _____

Above average pass rate (50-75%): _____

Consistently passes tests (>75%): _____

13

AIRP date: ____________ Not scheduled yet: ____

Extracurricular radiology conferences, radiology courses, radiology self-assessment modules attended or completed last 6 months: (upload to myPortfolio printed documentation of completetion)

1.

2.

14

PATIENT CARE

Hospital required modules completed: Yes ____ No _____

Module completed with dates certificates uploaded to myPortolio:

Patient Care module: _______

Radiation safety module: _______

Lines and catheter module: ________

MRI Safety lecture viewed: ________

Formative faculty evaluations: Satisfactory OR Needs improvement (circle one)

What areas could you improve?

BLS/ACLS: Currently certified? Yes OR No (circle one)

PALS: Yes OR No (circle one)

Case Logs:

# of cases submitted to ACGME: _____________ Date of last entry: ______________

Interventional log updated in New Innovations? Yes OR No (circle one)

Thyroid treatment log form up to date logged on New Innovations and uploaded to myPortfolio: Yes OR No (circle one)

Number of thyroid treatments (entire residency up to this evaluation):

<33 mCi: ____ >33 mCi: ____

Moonlighting? Yes____ No _____ Permission form signed? Yes ___ No ____

15

INTERPERSONAL AND COMMUNICATION SKILLS

Online modules completed:

Reviewed/read articles provided regarding reporting? Yes____ No____

Areas to improve on in reporting/dictation in areas you have been given feedback?

Formative faculty evaluations: Satisfactory OR Needs improvement (circle one)

What areas could you improve?

Resident lecture prepared and given in last 6 months? Yes____ No____

List topic(s) lecture prepared (uploaded to myPortfolio):

Goals to improve communication skills:

16

PRACTICE BASED LEARNING AND IMPROVEMENT

Radiology self-assessment modules completed: Yes _____ No ________

Research project required by the AOCR:

Documentation of participation in departmental QI/QA and regulatory activities?

Presentation and analysis of scientific articles at Journal Club (upload review form)?

Yes ______ No_____

Teaching File case preparation: Number of cases uploaded to DIA Teaching File system with complete discussions over the last 6 months? _______

M&M and Rad/Path conference presenter/attender with attendance documented?

Yes ______ No ______

Case Conferences/Lectures (Title and presented date and presentation/lecture uploaded to myPortfolio):

1.

2.

3.

4.

Other publications:

17

SYSTEM-BASED PRACTICE

Resident analysis of system-based problem Quality Initiative project title:

Multidisciplinary conferences involved in:

Radiology Business practice Online media/modules completed?: Yes ____ No___

Hospital required billing and documentation modules completed?: Yes ___ No ____

Hospital committee (s) involved in:

Participation in any internal review? Yes _____ No ______

Participation in medical student/resident selection?

Application review: Yes ____ No _____

Interview day(s): Yes ____ No _____

Rank meeting: Yes ____ No _____

18

PROFESSIONALISM

Formative faculty evaluations: Satisfactory Needs improvement (circle one)

What areas could you improve?

Conference attendance record: _______%

Work hours updated: Yes ___ No _____

Online modules completed:

Hospital/GME required modules and lectures:

Activity in professional societies or attendance at meetings?

List one thing you have done/helped, or would like to do to help OSUMC become a better place:

Scholarly Activity in last 6 months or upcoming 6 months:

Publications? Yes __________ No ________ Submitted or other__________ (date/journal)

Posters? Yes __________ No ________ Submitted __________ (date/Meeting)

Oral presentations? Yes __________ No ________ Submitted __________

Other? Yes __________ No ________ Explain: _________________________________

Faculty mentor:________________ Co-authors/collaborators names: ________________

Medical students you are mentoring? _____________________________

Added to your CV? Yes _______ No _______

Add to portfolio? Yes _______ No _______

Nominated for anything? Yes _______ No _______ If so, what? _______________

Goals for scholarly activity: __________________________________

19

Career Planning:

Fellowship?

Yes ________ No ________

Undecided ________ Applying or will apply______

Subspecialty? ___________________________

Accepted into program? _________________________ (institution name/state)

Practice goals:

Academics ________ Private practice________ Undecided________

Copy of current CV (include printed or CD) in portfolio? Yes _________ No _________

Evaluations:

On which rotations do you think you could improve?

Plans for improvement?

Formative peer evaluations: Satisfactory Needs improvement NA (circle one)

What areas could you improve?

Formative technologist/nurse evaluations: Satisfactory Needs improvement NA (circle one)

What areas could you improve?

Formative patient evaluations: Satisfactory Needs improvement NA (circle one)

What areas could you improve?

Any comments about any evaluations?

20

Program Director’s Annual Evaluation

Resident Name Training Program Year of Training for this Report

OGME 2܆ OGME 3܆ OGME 4܆ OGME 5܆

Training Year Dates From (mo/dy/yr) to (mo/dy/yr) Only check one evaluation box for each For any box checked deficient, the specifics of the deficiency must be detailed and a corrective action plan must be submitted as an addendum to this form. Competency 1: Osteopathic Philosophy Principles and Manipulative Treatment This competency is not to be evaluated separately but its teaching and evaluation in the training program shall occur through Competencies 2-7 into which this competency has been fully integrated. Competency 2: Medical Knowledge and Its Application into Osteopathic Practice 2.1 The resident demonstrated competency in the

understanding and application of clinical medicine to osteopathic patient care.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

2.2 The resident knows and applies the foundations of clinical and behavioral medicine appropriate to Diagnostic Radiology with application of all appropriate osteopathic correlations.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

2.3 The resident demonstrated a desire to continually improve his/her medical knowledge and that of others.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

Competency 3: Osteopathic Patient Care 3.1 The resident demonstrated the ability to develop a

management plan based on radiologic findings and other essential information gathered from all sources including medical interviews, osteopathic physical and structural examinations as indicated, medical records, diagnostic/therapeutic plans, and treatments.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

3.2 The resident demonstrated proper technique in planning and performing imaging and image-guided procedures including osteopathic diagnosis and treatment relative to radiology.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

3.3 The resident provided radiology services consistent with osteopathic philosophy, including preventative medicine and health promotion based on current scientific evidence.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

21

Competency 4: Interpersonal and Communication Skills in Osteopathic Medical Practice 4.1 The resident demonstrated effectiveness in developing

appropriate doctor-patient relationships. Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

4.2 The resident exhibited effective listening, written and oral communication skills in professional interactions with patients, families, and other healthcare professionals.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

4.3 The resident demonstrated an awareness of psychosocial issues and incorporates health promotion into clinical practice.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

Competency 5: Professionalism in Osteopathic Medical Practice 5.1 This resident demonstrated respect for his/her patients

and families and advocated for the primacy of his/her patient’s welfare and autonomy.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

5.2 The resident adhered to ethical principles in the practice of medicine.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

5.3 The resident demonstrated awareness and proper attention to issues of culture, religion, age, gender, sexual orientation, and mental and physical disabilities.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

5.4 The resident demonstrated awareness of one’s own mental and physical health.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

Competency 6: Osteopathic Medical Practice-Based Learning and Improvement 6.1 The resident treated patients in a manner consistent with

the most up-to-date information on diagnostic and therapeutic effectiveness (traditional and osteopathic).

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

6.2 The resident performed self-evaluations of clinical practice patterns and practice-based improvement activities using a systematic methodology.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

6.3 The resident understood research methods, medical informatics, and the application of technology as applied to medicine.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

Competency 7: System-Based Practice Osteopathic Medical Practice 7.1 This resident understands national and local health care

delivery systems and medical societies and how they affect patient care, professional practice, and relate to advocacy.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

7.2 This resident advocated for quality health care on behalf of his/her patients and assisted them in their interactions with the complexities of the medical system.

Deficient܆ Appropriate for level of training܆ Meets competency܆ Exceptional܆

22

1. The resident has passed all parts of the COMLEX examination.

(required prior to progression to 2nd year of residency) No ܆ Yes ܆

2. The resident has made satisfactory progress in the training program and is recommended to proceed to the next year. N/A ܆ No ܆ Yes ܆ If no, please explain:

NOTE: You must complete and submit a “Program Complete Summary - Final Resident Assessment” form for all residents who are completing training. ____________________________________________________________________________ (Signature of Program Director) (Date) The following signature verifies that the resident has had the opportunity to review this report. _____________________________________________________________________________ (Signature of Resident) (Date)

23

PROGRAM “COMPLETE” SUMMARY – FINAL RESIDENT ASSESSMENT

This resident has been assessed with at least two evaluation tools for each required element of each of the enumerated competencies. Yes No

A document portfolio of this resident’s ‘best performance” evaluations for each competency is attached to this report. Yes No

Please mark a summary assessment for each competency at Residency Program Completion

Osteopathic Philosophy, Principles and Manipulative Treatment

This competency is not to be evaluated separately but its teaching and evaluation in the training program shall occur through Competencies 2-7 into which this competency has been fully integrated.

Consistently Meets Competencies Exceptional Medical Knowledge and Its Application into Osteopathic Medical Practice

Osteopathic Patient Care Interpersonal and Communication Skills in Osteopathic Medical Practice

Professionalism in Osteopathic Medical Practice Osteopathic Medical Practice-based Learning and Improvement

System-based Osteopathic Medical Practice

I HEREBY ATTEST THAT THE GRADUATING RESIDENT HAS SUCCESSFULLY COMPLETED ALL THE REQUIREMENTS OF THE TRAINING PROGRAM, AND IS RECOMMENDED FOR PROGRAM COMPLETE STATUS.

Yes No If no, explain:

(Signature of Program Director) (Date) (Printed name of Program Director) (AOA Training Program) The following signature verifies that the resident has had the opportunity to review this report.

(Signature of Resident) (Date) (Printed name of Resident)

24

OSUMC Monthly Formative Radiology Resident Evaluation of Faculty Rotation: ________________________ Staff name: ______________________ Instructions: Please evaluate the faculty member by checking a number from 1 to 5 with 1 representing "almost never" and 5 "almost always" regarding how often the faculty member performs each behavior. For parameters for which you have had no direct observation or those which do not apply to your interactions with the faculty, check "NA" (not applicable). Your evaluation will be kept anonymous and only compiled data will be presented to the faculty. Comments may be given at the end of the form. GENERAL: 1. Staffs out studies early enough so that fellow/resident dictation can be completed by the end of the workday or the end of the scheduled call. Almost never 1 2 3 4 5 Almost always N/A 2. Staff works efficiently without complaining about the amount of work to do and is considerate by attempting to avoid putting all the work on the fellow/resident. Almost never 1 2 3 4 5 Almost always N/A 3. Staff regularly takes time out of work to teach fellow/resident how to recognize a diagnosis and associated imaging findings on an imaging study. Almost never 1 2 3 4 5 Almost always N/A 4. Regularly attends scheduled conferences/lectures. Almost never 1 2 3 4 5 Almost always N/A 5. At conferences, gives frequent high-quality teaching experience. Almost never 1 2 3 4 5 Almost always N/A 6. Varies teaching methods (lectures, case presentations, slides, films, video, etc.). Almost never 1 2 3 4 5 Almost always N/A AVAILABILITY: 1. Is available to help referring clinicians. Almost never 1 2 3 4 5 Almost always N/A FEEDBACK: 1. Gives the resident feedback during the rotation about how the resident is performing. Almost never 1 2 3 4 5 Almost always N/A EXPERTISE/CLINICAL SKILLS: 1. Maintains updated expertise by citing recent literature and new technology to resident (e.g. new radiological procedures, alternative imaging studies and methods). Almost never 1 2 3 4 5 Almost always N/A 2. Integrates imaging findings and clinical history to narrow the differential diagnosis. Almost never 1 2 3 4 5 Almost always N/A RESEARCH:

25

1. Helps fellow/resident design and overcome problems in pursuing the resident's own research project. Almost never 1 2 3 4 5 Almost always N/A 2. Staff makes him-/herself available to assist residents in writing manuscripts for publication or in preparing oral presentations for local, national meetings or medical school lectures. Almost never 1 2 3 4 5 Almost always N/A PROFESSIONALISM: 1. Speaks well of other staff in front of colleagues or residents. Almost never 1 2 3 4 5 Almost always N/A 2. Disagrees with a resident's interpretation without being insulting.

Almost never 1 2 3 4 5 Almost always N/A

26

OSUMC RADIOLOGY RESIDENT ANNUAL PROGRAM EVALUATION

1. On average, how many hours do you spend per week in assigned duties? _______/week

2. Do you average at least one day off per week? Yes_____ No _____

If not, which rotation(s) did this occur?

3. Do you feel that the program director and faculty members are available to you for advice and counseling?

Yes _____ No _____

4. Do you feel you get enough advice and counseling? Yes _____ No _____

5. Does the Staff radiologist at the beginning of each rotation review the written learning objectives and expectations with you?

Yes _____ No _____

If not, on which rotation(s) did this not occur?

4. Are you provided with written and verbal feedback at the end of each rotation? Yes _____ No ___

If not, on which rotation(s) would you have liked to have had some feed back?

5. Does the residency program place excessive reliance on service vs education? Yes _____ No _____

If yes, on which rotation(s) did this occur?

6. Is there a rapid and reliable system for you to communicate with your attending physicians?

Yes _____ No _____

If not, on which rotation(s) are there issues and what are the issues?

7. Are you provided an adequate work area (computer/place to hang coat facilities)? Yes _____ No _____

If not, at which facilities?

8. Do you have any concerns regarding your safety while at OSUMC or CMH?

Yes _____ No _____

If yes, at which facilities?

9. Are the library facilities adequate? Yes _____ No _____

If not, please comment:

10. Are you able to get enough procedures? Yes _____ No _____

If not, please comment on why that may be or give your suggestions for improvement:

11. My least favorite parts of the residency program are:

12. My favorite parts of the residency program are:

13. What would you suggest be done to improve the radiology residency program at OSUMC?

14. Please make any other comments here:

27

Faculty Evaluation of the Residency Program Please use this scale to answer questions 1-10: 1- Strongly Disagree; 2- Disagree; 3- Neutral; 4- Agree; 5- Strongly Agree ____1. PATIENT/CASE VOLUME: There are a sufficient number and variety of patients/cases to facilitate high quality resident/fellow education. ____2. CURRICULUM: The residency/fellowship program curriculum provides the appropriate educational experiences for residents/fellows to analyze, investigate and improve patient care practices. ____3. PROGRAM DIRECTOR: The program director effectively communicates with program faculty members to understand their role in resident/fellow education and development. ____4. ADMINISTRATIVE SUPPORT: There are adequate administrative support services to facilitate faculty participation in resident/fellow education. ____5. SUPERVISION: The program resident/fellow supervision policy has been clearly communicated to program faculty and is used by the program. ____6. TRANSITION OF CARE: The program transition of care/hand-off policy and tools have been distributed to program faculty and they are used. ____7. EVALUATION: Program faculty receive regular and timely feedback about their teaching and supervision skills. ____8. FACULTY DEVELOPMENT: There are beneficial resources available for program faculty to improve their teaching and supervision skills. ____9. SCHOLARLY ACTIVITY: Program faculty have the adequate resources to participate in scholarly activities. ____10. FACULTY: The program faculty provide the diversity of experience and expertise to accomplish the goals and objectives of the program. Please describe the strengths of the residency: Please describe the opportunities for improvement in the residency:

28

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 1

DIA

GN

OSTIC RA

DIO

LOG

Y MILESTO

NES

A

CGM

E REPORT W

OR

KSHEET

Patient Care and Technical Skills (Residents m

ust be able to meet previous year m

ilestones when evaluated at a specific level)

PCTS1: Consultant

Has not

Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

U

ses e

stab

lishe

d e

vid

en

ce-

ba

sed

ima

gin

g g

uid

elin

es su

ch

as A

me

rican

Co

lleg

e o

f

Ra

dio

log

y (A

CR

)

Ap

pro

pria

ten

ess C

riteria

®

Ap

pro

pria

tely

use

s the

Ele

ctron

ic He

alth

Re

cord

to

ob

tain

rele

va

nt clin

ical

info

rma

tion

Re

com

me

nd

s ap

pro

pria

te

ima

gin

g o

f com

mo

n*

con

ditio

ns in

de

pe

nd

en

tly

*A

s de

fine

d b

y th

e

resid

en

cy p

rog

ram

Re

com

me

nd

s ap

pro

pria

te

ima

gin

g o

f un

com

mo

n*

con

ditio

ns in

de

pe

nd

en

tly

*A

s de

fine

d b

y th

e

resid

en

cy p

rog

ram

Inte

gra

tes cu

rren

t rese

arch

an

d lite

ratu

re w

ith

gu

ide

line

s, tak

ing

into

con

side

ratio

n co

st

effe

ctive

ne

ss an

d risk

-

be

ne

fit an

aly

sis, to

reco

mm

en

d im

ag

ing

Pa

rticipa

tes in

rese

arch

,

de

ve

lop

me

nt, a

nd

imp

lem

en

tatio

n o

f ima

gin

g

gu

ide

line

s

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

3

60

Eva

lua

tion

/Mu

lti-rate

r/Pe

er

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

E

nd

-of-R

ota

tion

Glo

ba

l Asse

ssme

nt

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

E

nd

-of-Y

ea

r Exa

min

atio

n

S

imu

latio

n/O

SC

E

29

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 2

Patient Care and Technical Skills

PCTS2: Competence in procedures

H

as not Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

C

om

pe

ten

tly p

erfo

rms b

asic

pro

ced

ure

s* u

nd

er in

dire

ct

sup

erv

ision

Re

cog

nize

s an

d m

an

ag

es

com

plica

tion

s of b

asic

pro

ced

ure

s

*B

asic p

roce

du

res, a

s de

fine

d

by

ea

ch re

side

ncy

pro

gra

m,

inclu

de

tho

se n

ee

de

d to

tak

e

ind

ep

en

de

nt ca

ll

Co

mp

ete

ntly

pe

rform

s

inte

rme

dia

te p

roce

du

res,

as d

efin

ed

by

the

resid

en

cy

pro

gra

m

Re

cog

nize

s an

d m

an

ag

es

com

plica

tion

s of

inte

rme

dia

te p

roce

du

res

Co

mp

ete

ntly

pe

rform

s

ad

va

nce

d p

roce

du

res, a

s

de

fine

d b

y th

e re

side

ncy

pro

gra

m

Re

cog

nize

s an

d m

an

ag

es

com

plica

tion

s of a

dva

nce

d

pro

ced

ure

s

Ab

le to

com

pe

ten

tly a

nd

ind

ep

en

de

ntly

pe

rform

the

follo

win

g p

roce

du

res:

a

du

lt an

d p

ed

iatric

fluo

ro stu

die

s

lu

mb

ar p

un

cture

im

ag

e-g

uid

ed

ve

no

us

an

d a

rteria

l acce

ss

h

an

ds-o

n a

du

lt an

d

pe

dia

tric ultra

sou

nd

stud

ies

d

rain

ag

e o

f effu

sion

s

an

d a

bsce

sses

im

ag

e-g

uid

ed

bio

psy

n

ucle

ar m

ed

icine

I-

13

1 tre

atm

en

ts (< 3

3

an

d >

33

mC

i)

Ab

le to

tea

ch p

roce

du

res

to ju

nio

r-lev

el re

side

nts

Co

mp

ete

ntly

pe

rform

s

com

ple

x pro

ced

ure

s,

mo

difie

s pro

ced

ure

s as

ne

ed

ed

, an

d a

nticip

ate

s

an

d m

an

ag

es

com

plica

tion

s of co

mp

lex

pro

ced

ure

s

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

36

0 E

va

lua

tion

/Mu

lti-rate

r/Pe

er

E

nd

-of-R

ota

tion

Glo

ba

l Asse

ssme

nt

C

ase

/Pro

ced

ure

Log

s, inclu

din

g co

mp

licatio

ns

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

P

roce

du

ral co

mp

ete

ncy

che

cklists

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

S

imu

latio

n/O

SC

E

30

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 3

Medical Know

ledge

MK1: Protocol selection and optim

ization of images

H

as not Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

S

ele

cts ap

pro

pria

te p

roto

col

an

d co

ntra

st ag

en

t/do

se fo

r

ba

sic ima

gin

g, in

clud

ing

pro

toco

ls en

cou

nte

red

du

ring

ind

ep

en

de

nt ca

ll as d

efin

ed

by

the

resid

en

cy p

rog

ram

Re

cog

nize

s sub

-op

tima

l

ima

gin

g

Se

lects a

pp

rop

riate

pro

toco

ls an

d co

ntra

st

ag

en

t/do

se fo

r

inte

rme

dia

te im

ag

ing

as

de

fine

d b

y th

e re

side

ncy

pro

gra

m

Se

lects a

pp

rop

riate

pro

toco

ls an

d co

ntra

st

ag

en

t/do

se fo

r ad

va

nce

d

ima

gin

g a

s de

fine

d b

y th

e

resid

en

cy p

rog

ram

De

mo

nstra

tes k

no

wle

dg

e

of p

hy

sical p

rincip

les to

op

timize

ima

ge

qu

ality

Ind

ep

en

de

ntly

mo

difie

s

pro

toco

ls as d

ete

rmin

ed

by

clinica

l circum

stan

ces

Ap

plie

s ph

ysica

l prin

ciple

s

to o

ptim

ize im

ag

e q

ua

lity

Te

ach

es a

nd

/or w

rites

ima

gin

g p

roto

cols

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

C

ore

exa

m

O

SC

E/sim

ula

tion

31

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 4

Medical Know

ledge

MK2: Interpretation of exam

inations

Has not

Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

M

ak

es co

re o

bse

rva

tion

s,

form

ula

tes d

iffere

ntia

l

dia

gn

ose

s, an

d re

cog

nize

s

critical fin

din

gs

Diffe

ren

tiate

s no

rma

l from

ab

no

rma

l

Ma

ke

s seco

nd

ary

ob

serv

atio

ns, n

arro

ws th

e

diffe

ren

tial d

iag

no

sis, an

d

de

scribe

s ma

na

ge

me

nt

op

tion

s

Pro

vid

es a

ccura

te, fo

cuse

d,

an

d e

fficien

t

inte

rpre

tatio

ns

Prio

ritizes d

iffere

ntia

l

dia

gn

ose

s an

d

reco

mm

en

ds m

an

ag

em

en

t

Ma

ke

s sub

tle o

bse

rva

tion

s

Su

gg

ests a

sing

le d

iag

no

sis

wh

en

ap

pro

pria

te

Inte

gra

tes cu

rren

t rese

arch

an

d lite

ratu

re w

ith

gu

ide

line

s to re

com

me

nd

ma

na

ge

me

nt

De

mo

nstra

tes e

xpe

rtise

an

d e

fficien

cy a

t a le

ve

l

exp

ecte

d o

f a su

bsp

ecia

list

Ad

va

nce

s the

art a

nd

scien

ce o

f ima

ge

inte

rpre

tatio

n

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

R

ea

din

g o

ut w

ith re

side

nt

E

R p

rep

are

dn

ess te

st

R

evie

w o

f rep

orts

R

ate

of m

ajo

r discre

pa

ncie

s

C

ore

exa

m

32

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 5

Systems-based Practice

SBP1: Q

uality Improvem

ent (QI)

H

as not Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

D

escrib

es d

ep

artm

en

tal Q

I

initia

tive

s

De

scribe

s the

de

pa

rtme

nta

l

incid

en

t/occu

rren

ce re

po

rting

syste

m

Inco

rpo

rate

s QI in

to

clinica

l pra

ctice

Pa

rticipa

tes in

the

de

pa

rtme

nta

l

incid

en

t/occu

rren

ce

rep

ortin

g sy

stem

Ide

ntifie

s an

d b

eg

ins a

syste

ms-b

ase

d p

ractice

pro

ject in

corp

ora

ting

QI

me

tho

do

log

y

Co

mp

lete

s a sy

stem

s-

ba

sed

pra

ctice p

roje

ct as

req

uire

d b

y th

e A

CG

ME

Re

vie

w C

om

mitte

e

De

scribe

s na

tion

al

rad

iolo

gy

qu

ality

pro

gra

ms

(e.g

., Na

tion

al R

ad

iolo

gy

Da

ta R

eg

istry,

accre

dita

tion

, pe

er-re

vie

w)

Lea

ds a

tea

m in

the

de

sign

an

d im

ple

me

nta

tion

of a

QI p

roje

ct

Ro

utin

ely

pa

rticipa

tes in

roo

t cau

se a

na

lysis

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

3

60

Eva

lua

tion

/Mu

lti-rate

r/Pe

er

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

S

em

i-an

nu

al e

va

lua

tion

with

pro

gra

m d

irecto

r

W

ritten

fee

db

ack

on

pro

ject (w

ith m

en

tor)

P

roje

ct pre

sen

tatio

n fe

ed

ba

ck (fa

culty

, pe

ers, o

the

rs in sy

stem

)

C

ritical in

cide

nts re

po

rting

an

d fe

ed

ba

ck

33

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 6

Systems-based Practice

SBP2: H

ealth care economics

H

as not Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

D

escrib

es th

e m

ech

an

isms fo

r

reim

bu

rsem

en

t, inclu

din

g

typ

es o

f pa

yo

rs

Sta

tes re

lativ

e co

st of

com

mo

n p

roce

du

res

De

scribe

s the

tech

nica

l an

d

pro

fessio

na

l com

po

ne

nts

of im

ag

ing

costs

De

scribe

s me

asu

rem

en

ts

of p

rod

uctiv

ity (e

.g., R

VU

s)

De

scribe

s the

rad

iolo

gy

rev

en

ue

cycle

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

P

roje

ct pre

sen

tatio

n fe

ed

ba

ck (fa

culty

, pe

ers, o

the

rs in sy

stem

)

C

om

ple

tion

of k

no

wle

dg

e-b

ase

d m

od

ule

s

Suggested educational strategies:

An

nu

al Q

A se

ssion

with

he

ad

of b

illing

In

stitute

for H

ea

lth C

are

Inte

rna

tion

al m

od

ule

s

Ag

en

cy fo

r He

alth

care

Re

sea

rch a

nd

Qu

ality

mo

du

les

34

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 7

Practice-based Learning and Improvem

ent

PBLI1: Patient safety: contrast agents; radiation safety; M

R safety; sedation

H

as not Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

Contrast A

gents: R

eco

gn

izes a

nd

ma

na

ge

s

con

trast re

actio

ns

Radiation Safety:

De

scribe

s the

me

cha

nism

s of

rad

iatio

n in

jury

an

d th

e A

LAR

A

(“as lo

w a

s rea

son

ab

ly

ach

ieva

ble”) co

nce

pt

MR

Safety: D

escrib

es risk

s of M

RI

Contrast Agents:

Re

-de

mo

nstra

tes

reco

gn

ition

an

d

ma

na

ge

me

nt o

f con

trast

rea

ction

s

Radiation Safety:

Acce

sses re

sou

rces to

de

term

ine

exa

m-sp

ecific

ave

rag

e ra

dia

tion

do

se

info

rma

tion

MR

Safety: A

ccesse

s reso

urce

s to

de

term

ine

the

safe

ty o

f

imp

lan

ted

de

vice

s an

d

reta

ine

d m

eta

l

Contrast Agents:

Re

-de

mo

nstra

tes

reco

gn

ition

an

d

ma

na

ge

me

nt o

f con

trast

rea

ction

s

Radiation Safety:

Co

mm

un

icate

s the

rela

tive

risk o

f exa

m-sp

ecific

rad

iatio

n e

xpo

sure

to

pa

tien

ts an

d p

ractitio

ne

rs

MR

Safety: C

om

mu

nica

tes M

R sa

fety

of co

mm

on

imp

lan

ts an

d

reta

ine

d fo

reig

n b

od

ies to

pa

tien

ts an

d p

ractitio

ne

rs

Contrast Agents:

Re

-de

mo

nstra

tes

reco

gn

ition

an

d

ma

na

ge

me

nt o

f con

trast

rea

ction

s

Radiation Safety:

Ap

plie

s prin

ciple

s of Im

ag

e

Ge

ntly

® a

nd

Ima

ge

Wise

ly®

MR

Safety: A

pp

lies p

rincip

les o

f MR

safe

ty in

clud

ing

safe

ty

zon

es a

nd

pre

-MR

scree

nin

g

Sedation:

De

scribe

s the

prin

ciple

s of

con

sciou

s sed

atio

n

Contrast Agents:

Te

ach

es a

pp

rop

riate

trea

tme

nt o

f con

trast

rea

ction

s

Radiation Safety:

Pro

mo

tes ra

dia

tion

safe

ty

MR

Safety: P

articip

ate

s in e

stab

lishin

g

or d

irectin

g a

safe

MR

pro

gra

m

Sedation:

Se

lects a

pp

rop

riate

sed

atio

n a

ge

nt a

nd

do

se

for co

nscio

us se

da

tion

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

3

60

Eva

lua

tion

/Mu

lti-rate

r/Pe

er

S

imu

latio

n/O

SC

E

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

C

om

ple

tion

of in

stitutio

na

l safe

ty m

od

ule

s, BC

LS/A

CLS

35

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 8

Practice-based Learning and Improvem

ent

PBLI2: Self-D

irected Learning

Has not

Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

D

ev

elo

ps a

n a

nn

ua

l lea

rnin

g

pla

n b

ase

d o

n se

lf-refle

ction

an

d p

rog

ram

fee

db

ack

Eva

lua

tes a

nd

mo

difie

s

lea

rnin

g p

lan

Eva

lua

tes a

nd

mo

difie

s

lea

rnin

g p

lan

Eva

lua

tes a

nd

mo

difie

s

lea

rnin

g p

lan

Ad

vo

cate

s for life

lon

g

lea

rnin

g a

t loca

l an

d

na

tion

al le

ve

ls

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

S

em

i-an

nu

al e

va

lua

tion

me

etin

g w

ith p

rog

ram

dire

ctor

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

R

esid

en

t tea

chin

g a

nd

fee

db

ack

C

ore

exa

m

36

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 9

Practice-based Learning and Improvem

ent

PBLI3: Scholarly activity

H

as not Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

D

ocu

me

nts tra

inin

g in

critical

thin

kin

g sk

ills an

d re

sea

rch

de

sign

Wo

rks w

ith fa

culty

me

nto

rs to id

en

tify

po

ten

tial sch

ola

rly p

roje

cts

Be

gin

s scho

larly

pro

ject

Co

mp

lete

s an

d p

rese

nts a

scho

larly

pro

ject

Ind

ep

en

de

ntly

con

du

cts

rese

arch

an

d co

ntrib

ute

s

to th

e scie

ntific lite

ratu

re

an

d/o

r com

ple

tes m

ore

tha

n o

ne

scho

larly

pro

ject

Co

mp

lete

s an

IRB

sub

missio

n

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

C

ore

exa

m

Jo

urn

al clu

b d

iscussio

ns

W

ritten

fee

db

ack

on

pro

ject (w

ith m

en

tor)

P

roje

ct pre

sen

tatio

n fe

ed

ba

ck (fa

culty

, pe

ers, o

the

rs in sy

stem

)

C

om

ple

tion

of A

JR S

elf-A

ssessm

en

t Mo

du

les o

r CIT

I mo

du

les

37

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 10

Professionalism

PRO

F1: Professional Values and Ethics

H

as not Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

D

em

on

strate

s the

follo

win

g

pro

fessio

na

l be

ha

vio

rs:

re

cog

nize

s the

imp

orta

nce

an

d p

riority

of

pa

tien

t care

an

d

ad

vo

cate

s for p

atie

nt

inte

rests

fu

lfills wo

rk-re

late

d

resp

on

sibilitie

s

is tru

thfu

l

re

cog

nize

s pe

rson

al

limita

tion

s an

d se

ek

s he

lp

wh

en

ap

pro

pria

te

re

cog

nize

s pe

rson

al

imp

airm

en

t an

d se

ek

s

he

lp w

he

n n

ee

de

d

re

spo

nd

s ap

pro

pria

tely

to

con

structiv

e criticism

p

lace

s ne

ed

s of p

atie

nts

be

fore

self

m

ain

tain

s ap

pro

pria

te

bo

un

da

ries w

ith p

atie

nts,

colle

ag

ue

s, an

d o

the

rs

e

xhib

its tole

ran

ce a

nd

acce

pta

nce

of d

ive

rse

ind

ivid

ua

ls an

d g

rou

ps

m

ain

tain

s pa

tien

t

con

fide

ntia

lity

fu

lfills institu

tion

al a

nd

pro

gra

m re

qu

irem

en

ts

rela

ted

to p

rofe

ssion

alism

an

d e

thics

a

tten

ds re

qu

ired

Is an

effe

ctive

he

alth

care

tea

m m

em

be

r

De

mo

nstra

tes p

rofe

ssion

al

be

ha

vio

rs listed

in th

e

seco

nd

colu

mn

Is an

effe

ctive

he

alth

care

tea

m le

ad

er, p

rom

otin

g

prim

acy

of p

atie

nt w

elfa

re,

pa

tien

t au

ton

om

y, a

nd

socia

l justice

De

mo

nstra

tes p

rofe

ssion

al

be

ha

vio

rs listed

in th

e

seco

nd

colu

mn

Se

rve

s as a

role

mo

de

l for

pro

fessio

na

l be

ha

vio

r

De

mo

nstra

tes p

rofe

ssion

al

be

ha

vio

rs listed

in th

e

seco

nd

colu

mn

Pa

rticipa

tes in

loca

l an

d

na

tion

al o

rga

niza

tion

s to

ad

va

nce

pro

fessio

na

lism

in ra

dio

log

y

Me

nto

rs oth

ers re

ga

rdin

g

pro

fessio

na

lism a

nd

eth

ics

38

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 11

con

fere

nce

s

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

3

60

Eva

lua

tion

/Mu

lti-rate

r/Pe

er

S

imu

latio

n/O

SC

E

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

C

on

fere

nce

atte

nd

an

ce lo

gs

T

ime

line

ss in co

mp

letin

g in

stitutio

na

l an

d p

rog

ram

req

uire

me

nts

Suggested Educational Tools: 1

. Teaching  and  Assessing  Professionalism

:  A  Program  Director’s  Guide  by  the  ABP  and  APPD  –

see

Ch

ap

ter 8

: Me

asu

ring

Pro

fessio

na

lism

C

ritical in

cide

nts

P

ee

r asse

ssme

nts

M

ulti-so

urce

asse

ssme

nts

P

rofe

ssion

alism

Min

i-Eva

lua

tion

Exe

rcise (P

-ME

X)

2.

Th

e P

rofe

ssion

alism

Min

i-Eva

lua

tion

Exe

rcise:

A P

relim

ina

ry In

ve

stiga

tion

R

icha

rd C

rue

ss, Jod

i He

rold

McIlro

y, S

ylv

ia C

rue

ss, Sh

iph

ra G

insb

urg

, an

d Y

vo

nn

e S

tein

ert A

cad

Me

d. 2

00

6 O

ct;81

(10

Su

pp

l):S7

4-8

3.

AB

RF

On

line

Mo

du

les o

n E

thics a

nd

Pro

fessio

na

lism

http

s://ww

w.a

bro

nlin

e.o

rg/a

sp/a

brf/

4.

“Medical  Professionalism

 in  the  New

 Millennium

:  A  Physician  Charter.” Ann Intern M

ed. 5

Fe

bru

ary

20

02

;13

6(3

):24

3-2

46

. "

39

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 12

Interpersonal and Comm

unication Skills

ICS1: Effective comm

unication with patients, fam

ilies, and caregivers

Has not

Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

C

om

mu

nica

tes in

form

atio

n

ab

ou

t ima

gin

g a

nd

exa

min

atio

n

resu

lts in ro

utin

e,

un

com

plica

ted

circum

stan

ces

Ob

tain

s info

rme

d co

nse

nt

Co

mm

un

icate

s, un

de

r

dire

ct* su

pe

rvisio

n, in

cha

llen

gin

g circu

msta

nce

s

(e.g

., cog

nitiv

e

imp

airm

en

t, cultu

ral

diffe

ren

ces, la

ng

ua

ge

ba

rriers, lo

w h

ea

lth

litera

cy)

Co

mm

un

icate

s, un

de

r

dire

ct sup

erv

ision

, difficu

lt

info

rma

tion

such

as e

rrors,

com

plica

tion

s, ad

ve

rse

ev

en

ts, an

d b

ad

ne

ws

*se

e A

CG

ME

de

finitio

n o

f

dire

ct sup

erv

ision

in th

e

Pro

gra

m R

eq

uire

me

nts

Co

mm

un

icate

s, un

de

r

ind

irect*

sup

erv

ision

, in

cha

llen

gin

g circu

msta

nce

s

(e.g

., cog

nitiv

e

imp

airm

en

t, cultu

ral

diffe

ren

ces, la

ng

ua

ge

ba

rriers, lo

w h

ea

lth

litera

cy)

*se

e A

CG

ME

de

finitio

n o

f

dire

ct sup

erv

ision

in th

e

Pro

gra

m R

eq

uire

me

nts

Co

mm

un

icate

s com

ple

x

an

d d

ifficult in

form

atio

n,

such

as e

rrors,

com

plica

tion

s, ad

ve

rse

ev

en

ts, an

d b

ad

ne

ws

Se

rve

s as a

role

mo

de

l for

effe

ctive

an

d

com

pa

ssion

ate

com

mu

nica

tion

De

ve

lop

s pa

tien

t-cen

tere

d

ed

uca

tion

al m

ate

rials

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

3

60

Eva

lua

tion

/Mu

lti-rate

r/Pe

er

S

imu

latio

n/O

SC

E

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

40

Ve

rsion

12

/20

12

Copyright (c) 2012 The Accreditation Council for G

raduate Medical Education and The A

merican Board of Radiology. A

ll rights reserved. The copyright ow

ners grant third parties the right to use the Diagnostic Radiology M

ilestones on a non-exclusive basis for educational purposes. 13

Interpersonal and Comm

unication Skills

ICS2: Effective comm

unication with m

embers of the health care team

Has not

Achieved Level 1

Level 1 Level 2

Level 3 Level 4

Level 5

A

dh

ere

s to tra

nsfe

r-of-ca

re

po

licies

Written/Electronic:

Ge

ne

rate

s accu

rate

rep

orts

with

ap

pro

pria

te e

lem

en

ts

req

uire

d fo

r cod

ing

Verbal:

Co

mm

un

icate

s urg

en

t an

d

un

exp

ecte

d fin

din

gs a

ccord

ing

to in

stitutio

na

l po

licy a

nd

AC

R

gu

ide

line

s

Written/Electronic:

Efficie

ntly

ge

ne

rate

s clea

r

an

d co

ncise

rep

orts th

at d

o

no

t req

uire

sub

stan

tive

facu

lty m

em

be

r corre

ction

on

rou

tine

case

s

Verbal:

Co

mm

un

icate

s find

ing

s

an

d re

com

me

nd

atio

ns

clea

rly a

nd

con

cisely

Written/Electronic:

Efficie

ntly

ge

ne

rate

s clea

r

an

d co

ncise

rep

orts th

at d

o

no

t req

uire

sub

stan

tive

facu

lty m

em

be

r corre

ction

on

com

mo

n co

mp

lex ca

ses

Verbal:

Co

mm

un

icate

s

ap

pro

pria

tely

un

de

r

stressfu

l situa

tion

s

Written/Electronic:

Efficie

ntly

ge

ne

rate

s clea

r

an

d co

ncise

rep

orts th

at d

o

no

t req

uire

sub

stan

tive

facu

lty m

em

be

r corre

ction

on

all ca

ses

Verbal:

Co

mm

un

icate

s effe

ctive

ly

an

d p

rofe

ssion

ally

in a

ll

circum

stan

ces

Lea

ds in

terd

isciplin

ary

con

fere

nce

s

Written/Electronic:

Ge

ne

rate

s tailo

red

rep

orts

me

etin

g n

ee

ds o

f refe

rring

ph

ysicia

n

De

ve

lop

s tem

pla

tes a

nd

rep

ort fo

rma

ts

Verbal:

Se

rve

s as a

role

mo

de

l for

effe

ctive

com

mu

nica

tion

Co

mm

en

ts:

Possible Methods of A

ssessment/Exam

ples:

En

d-o

f-Ro

tatio

n G

lob

al A

ssessm

en

t

3

60

Eva

lua

tion

/Mu

lti-rate

r/Pe

er

S

imu

latio

n/O

SC

E (In

trad

ep

artm

en

tal a

nd

Te

am

)

D

irect o

bse

rva

tion

an

d fe

ed

ba

ck

S

elf-A

ssessm

en

t an

d R

efle

ction

s/Po

rtfolio

41