Evaluation of Wessex Courses     Evaluation of Wessex Courses                               

A surrogate measure of their A surrogate measure of their impactimpact

Mark GoodwinMark Goodwin

Associate Dean, Heath Education Associate Dean, Heath Education WessexWessex

The Haven ConferenceFriday 10 Jan 2014

Wessex CoursesWessex Courses

Wessex CoursesWessex Courses

Premise for AnalysisPremise for Analysis

The The surrogatesurrogate measure of the impact measure of the impact value of a Course is the Exam pass rate value of a Course is the Exam pass rate (as most if not all the Courses are (as most if not all the Courses are aligned to a national examination)aligned to a national examination)

ALL Heads of School & TPD’s be ALL Heads of School & TPD’s be aware of the annual pass rate for their aware of the annual pass rate for their traineestrainees

Request for InformationRequest for Information

Letter to all Head of Schools 16 July 2013Letter to all Head of Schools 16 July 2013 Deadline for responses Friday 20 Sept Deadline for responses Friday 20 Sept

2013 2013 Exam pass rates from Head of SchoolsExam pass rates from Head of Schools Evaluations from WCCEvaluations from WCC Responses:Responses:

Radiology: Radiology: Caroline RubinCaroline Rubin Anaesthetics:Anaesthetics: Paul SpargoPaul Spargo FSRH:FSRH: Fiona SizmurFiona Sizmur

Standard Evaluation Standard Evaluation TemplateTemplate

Bar ChartBar Chart RelevanceRelevance StructureStructure InterestInterest

Free text comments Free text comments VenueVenue AdminAdmin

Frequency of Scores Frequency of Scores

%100

90-9980-8970-7960-69

-

RelevanceRelevance

StructureStructure

InterestInterest

20122012

20132013

RadiologyRadiologyHoS: Caroline RubinHoS: Caroline Rubin

26 8 1326 8 13 FRCR Pt 1 (5112)FRCR Pt 1 (5112)

2012 & 2013 Pass 2012 & 2013 Pass rate:rate: Anatomy 75%Anatomy 75% Physics 62.5%Physics 62.5%

FRCR Pt 2a (5212)FRCR Pt 2a (5212)

2012 & 2013 Pass 2012 & 2013 Pass rate:rate: All modules All modules

79.2%79.2% FRCSR Pt2b 75%FRCSR Pt2b 75%

AnaestheticsAnaestheticsHoS: Paul SpargoHoS: Paul Spargo

12 9 1312 9 13

Primary FRCA (2013)Primary FRCA (2013)

National National WessexWessex

MCQ MCQ 49%49% NKNK

MCQMCQ 51%51% 69%69%

OSCEOSCE 46%46% 50%50%

OSCEOSCE 56%56% 77%77%

AnaestheticsAnaestheticsHoS: Paul SpargoHoS: Paul Spargo

12 9 1312 9 13

Final FRCA (2013)Final FRCA (2013)

National National WessexWessex

SAQSAQ 49%49% NKNK

SAQSAQ 59%59% 75%75%

SOESOE 63%63% 82%82%

SAQSAQ 65%65% 73%73%

AnaestheticsAnaestheticsFSRHFSRH: Fiona Sizmur: Fiona Sizmur

14 8 1314 8 13 Only recently recognised as specialty by Only recently recognised as specialty by

GMCGMC Course: 8112Course: 8112 Diploma aligned course for FacultyDiploma aligned course for Faculty Important for their RevalidationImportant for their Revalidation 1 trainee in FSRH in Wessex1 trainee in FSRH in Wessex

Exception reportingException reporting

Highly regardedHighly regarded

FRCS Intensive FRCS Intensive StudyStudy

FRCA WIP OSCEFRCA WIP OSCE Intro to Obs Intro to Obs

Anaesth.Anaesth. MRCP Pt 2 WrittenMRCP Pt 2 Written

Recording 70-79%Recording 70-79%

MRCS Course (5312a) MRCS Course (5312a) July 2012 July 2012

MRCS Course (5312b) MRCS Course (5312b)

Sept 2013Sept 2013 Basic Science Course Basic Science Course

52125212 June 2012June 2012

FRSH FacultyFRSH Faculty

Recording 60-69%Recording 60-69% FRCA Final Revision FRCA Final Revision

Course (912b) June 2013:Course (912b) June 2013:

FRCA Intensive Revision FRCA Intensive Revision (912b)(912b)

Nov 2012Nov 2012

SummarySummary

The majority of courses are well The majority of courses are well regarded and some consistently highly regarded and some consistently highly regarded.regarded.

There was a poor response to Exam There was a poor response to Exam pass rates from HoSpass rates from HoS

Importance of reviewing written Importance of reviewing written commentscomments

Thank youThank you

For ConsiderationFor Consideration

Do you agree all TPDs and HoS’s Do you agree all TPDs and HoS’s mustmust know trainee pass rates? know trainee pass rates?

How will we achieve this with 100% How will we achieve this with 100% compliance by Jan 2015?compliance by Jan 2015?

For ConsiderationFor Consideration

What is the role of Wessex Courses What is the role of Wessex Courses in the multi-professional in the multi-professional environment?environment?

How will we embrace this change for How will we embrace this change for the benefit of patient safety?the benefit of patient safety?