Resident SelectionSharing experiences from using selection science to find the best

surgical trainees

Brian J. Dunkin, MD, FACS

TSDA General Session

Disclosure

• Not a selection scientist

Disclosure

• I found someone with whom to collaborate!

Aimee Gardner, PhD

Assistant Dean of Evaluation & Research

School of Health Professions

Associate Professor, Health Professions & Surgery

Baylor College of Medicine

Houston, Texas

Disclosure

• Ownership interest in SurgWise

Let me tell you a story …

Typical file

• USMLE

• ABSITE

• MIS Case Numbers

• Unstructured letters of recommendation

• Unstructured personal statements

• Unstructured CV

Assessment Tools

USMLE / ABSITE / GRADES

Assessment Tools

We do lots of interviews

Assessment Tools

How could we do this better?

Job Analysis

Job Requirements Competencies

Competencies Assessments

Situational Judgment Tests (SJTs)

Personality Profile

• Agreeableness

• Extraversion

• Emotional Stability

• Openness to new experiences

• Conscientiousness

Gardner AK, Dunkin BJ. JAMA Surgery 2017

Course Topic Delivery Method

DidacticsCase-based

Review

Small Group

DiscussionRole Play

Other Active

Learning

Strategies

Part I: Background

Structured Interview Basics x x

Question Development x x

Biases in Interviews x x

Part II: Asking Questions

Getting Complete Responses x x

Types of Interviewing Questions x x

Unacceptable & Illegal Questions x x x x

Taking Notes x x

Part III: Assessment

Assigning Ratings x x x x

Motivational Fit x x

Integrating Data x x

Part IV: Putting it All Together

Interview Day Basics x

Review x x

Technical Skills

• Fast-paced program

• High complexity

• Time-compressed environment

Gardner AK, Dunkin BJ. Annals of Surgery 2018

Could Fit But …

Great Fit

Not A Good Fit

Gardner AK, Dunkin BJ. Annals of Surgery 2018

Structured Interviews Skills Testing

Information on MIS Candidates for Ranking

• SJT• 26 questions

• 130 unique data points

• Personality profile

• 9 competencies interviews

• 3 competencies group

• Technical skills

Results

Gardner AK, Dunkin BJ. Annals of Surgery 2018

Gardner AK, Dunkin BJ. Annals of Surgery 2018

Gardner AK, Dunkin BJ. Annals of Surgery 2018

55 applicants invited to take

online assessment

50 (91%) completed

42 minutes

80%improved

agreement among

interviewers

45%increase in

knowledge of how to conduct

structured interviews

45%higher in how to avoid illegal

questions

Over 50% less interviews

Success!

Competency-based SelectionAimee K. Gardner, PhD