Introduction to the new assessments

Dr Andrew Stewart

Lighthouse Medical Practice

Eastbourne

What’s new about them?

The point of them is to assess what everyone actually does – not what we “should” do.

More “in-house” assessments – throughout the 3 years

What types of assessment are there?

• AKT

• CSA

• WPBA – CBD, COT, mini CEX, DOPS, MSF and PSQ

Competency areas

• 1. Communication and consulting skills

• 2. Practising holistically• 3. Data gathering and

interpretation• 4. Making a diagnosis/

making decisions• 5. Clinical management• 6. Managing complexity

and promoting health

• 7. Primary care administration and IMT

• 8. Working with colleagues and in teams

• 9. Community orientation• 10. Maintaining

performance, learning and teaching

• 11. Maintaining an ethical approach to practice

• 12.Fitness to practice

Case-based discussion

• Structured oral interview

• Designed to assess professional judgement

• Across a range of competency areas

• Starting point is the written record of cases selected by the trainee

• Will be used in general practice and hospital settings

COT/Mini-CEX

• Tool to assess consultation skills

• Based on MRCGP consulting skills criteria

• Can be assessed using video or direct observation during general practice settings

DOPS

• For assessing relevant technical skills during GP training:– Cervical cytology– Complex or intimate examinations

(e.g. rectal, pelvic, breast)– Minor surgical skills

• Similar to F2 DOPS

MSF

• Assessment of clinical ability and professional behaviour

• ST1 Rated by 5 clinical colleagues on 2 occasions; ST3 Rated by 5 clinical and 5 non-clinical colleagues on 2 occasions

• Simple web based tool

• Feedback from Clinical Supervisor

PSQ

• Measures consultation and relational empathy (CARE)

• 30 consecutive consultations in GP setting

• Central optical scanning and generation of results

• Feedback from Educational supervisor

Others

• From direct observation during training

• “tagged” against appropriate competency headings

Monitoring

• 4 monthly by Educational supervisor (trainer)

• Deanery Panel meeting at end of ST1 and ST2 • reviews the training records of every trainee • face to face review with trainees when

• unsatisfactory achievement in either of the complementary tools

• or when requested by the educational supervisor

Yearly Targets

ST1, ST2• 6 x COT or mini-CEX • 6 x CBD• 2 x MSF (not ST2)• DOPS **• Clinical supervisors’

report **

ST3• 12 x COT• 12 x CBD• 2 x MSF• DOPS ** • 1x PSQ

The Final Judgement!

• The trainer makes a recommendation as to whether the trainee has achieved competence in all 12 areas at the end of training

• Review of e-portfolio if satisfactory level achieved in training record

• Review of e-portfolio and face-to-face meeting with trainee, if satisfactory level not achieved

Group work on CBD

• Divide into groups • Think of one recent consultation you have had –

ward based/OP clinic/surgery• What competencies did you demonstrate?• What competencies could you demonstrate?• Are there scenarios that could provide

demonstration of further competencies?

Where to turn?

• Clinical supervisor

• Educational Supervisor

• Programme Directors

• Peers

• Books/internet

Take-away

• Continual assessment

• Of what we DO

• Backed up by external assessments – local and central

• Close review by Educational Supervisor

• Driven by GPST