orthopaedic research and selection

8/6/2019 Orthopaedic Research and Selection

1/22

Does The Selection To HigherDoes The Selection To Higher

Orthopaedic Training PredictOrthopaedic Training PredictSubsequent Academic Output?Subsequent Academic Output?

A Ten-year evaluation.A Ten-year evaluation.BA RogersBA Rogers11, NJ Little, NJ Little22, MC Solan, MC Solan33, DM Ricketts, DM Ricketts44

1Mount Sinai Hospital, Toronto, Canada.

2East Surrey Hospital, Redhill, UK

3 Royal Surrey County Hospital, Guildford, UK

4

The Princess Royal Hospital, Haywards Heath,UK


2/22


3/22

Medical School

FoundationYears2 years

Specialist Training(ST)

Core training 2 years

Specialty Training 5years

HospitalConsultant

House Officer1 years

Senior HouseOfficer

3-4 years

Specialist Registrar(SpR)6 years

HospitalConsultant

9 years10 - 11 years

Prior to2007

From2007

CompetitiveSelection


4/22

FRCS ExamLogbookAnnual

Appraisal

PublicationsAbstracts

ExperienceCourses


5/22

IntroductionIntroduction

UK trauma and orthopaedics curriculum statesUK trauma and orthopaedics curriculum states

trainees must provide a portfolio demonstratingtrainees must provide a portfolio demonstrating

competences in personal research, assessment of thecompetences in personal research, assessment of theresearch of others and evidence of auditresearch of others and evidence of audit


6/22


7/22

AimsAims

1.1. Quantify the academic output of traineesQuantify the academic output of trainees

2.2. Assess the value of short-listing and interview scores inAssess the value of short-listing and interview scores in

predicting subsequent performance as an orthopaedicpredicting subsequent performance as an orthopaedictraineetrainee


8/22

MethodsMethods

Prospective studyProspective study One UK training region South West ThamesOne UK training region South West Thames One teaching/academic hospital, 10 communityOne teaching/academic hospital, 10 community

hospitalshospitals all Trainees from 2000-2010all Trainees from 2000-2010 n=115n=115

Data collated from theData collated from the selection process :selection process :

short-listingshort-listing interview scoresinterview scores

Annual Appraisal :Annual Appraisal : published paperspublished papers Other publicationsOther publications


9/22

MethodsMethods

Short-listing and interview scoresShort-listing and interview scores Divided into 3 groupsDivided into 3 groups

Upper 1/3Upper 1/3 Middle 1/3Middle 1/3 Lower 1/3Lower 1/3

Compared againstCompared against research outputresearch output annual appraisal scoreannual appraisal score

Statistics usedStatistics used MANOVAMANOVA

Paired t-testPaired t-test


10/22

DefinitionsDefinitions

Published PaperPublished Paper work published and supplied with a Vancouverwork published and supplied with a Vancouverreferencereference Included original research / audit / reviewIncluded original research / audit / review Excluded research submitted or in pressExcluded research submitted or in press

Other publicationsOther publications Published abstracts, letters, case reports, casePublished abstracts, letters, case reports, case

series, posters at conferencesseries, posters at conferences Excluded online only publicationsExcluded online only publications

Research output scoreResearch output score 3 points for published paper3 points for published paper 1 point for published other1 point for published other


11/22

Academic outputAcademic outputpublished paperspublished papers

At completion of training: mean 4.7 (0-23),

median 4


12/22


13/22

ResultsResults


14/22

Profile of shortlist and interview scores

(for appointed candidates)

Numbero

Percentage with respect to maximum score

Shortlist

Interview


15/22

Academic outputAcademic outputby interview scoreby interview score

Academic

Outp

uYear of higher surgical training


16/22

Academic outputAcademic outputby short list scoreby short list score

Year of higher surgical training

Aca

demicO

utp


17/22

DiscussionDiscussion

By completion of training recommend min 2.2

papers (- x1 SD)


18/22

By completion of training recommend min 5.4

other publications (- x1 SD)



19/22

Trainee excusesTrainee excuses..for lack of progressfor lack of progress

Work-related explanations

Im waiting for statistical

analysis

The other authors have not yet

approved the text.

Im awaiting a decision from a

journal editor.

Im too busy operating

Domestic-related explanations

My computer crashed.

Im reading Harry Potter at themoment.

I put a nail through a pipe in the

bathroom.

Im painting the spare room.

Sorry, Im going to Australia.


20/22


Competitive selection existsCompetitive selection exists Training postsTraining posts Consultant postsConsultant posts

Interview scoreInterview score wider range (ie larger SD cf shortlisting)wider range (ie larger SD cf shortlisting) more difference between candidatesmore difference between candidates

Higher interview scores associated withHigher interview scores associated with

improved academic performanceimproved academic performance higher annual appraisal scorehigher annual appraisal score


21/22

ConclusionConclusionRecommendationsRecommendations

At interviewAt interview Lower 1/3 score : possible additional supportLower 1/3 score : possible additional support

as traineeas trainee

Upper 1/3 score : encouraged to useUpper 1/3 score : encouraged to useresearch skills & consider academic postsresearch skills & consider academic posts

Selection processSelection processLongListing

ExtensiveInterview

s

Selection to

Specialty

Shortlisting


22/22

THANK YOUTHANK YOU

orthopaedic research and selection

Documents