introduction to the new assessments

Introduction to the new assessments

Dr Andrew Stewart

Lighthouse Medical Practice

Eastbourne

What’s new about them?

The point of them is to assess what everyone actually does – not what we “should” do.

More “in-house” assessments – throughout the 3 years

What types of assessment are there?

• AKT

• CSA

• WPBA – CBD, COT, mini CEX, DOPS, MSF and PSQ

Competency areas

• 1. Communication and consulting skills

• 2. Practising holistically• 3. Data gathering and

interpretation• 4. Making a diagnosis/

making decisions• 5. Clinical management• 6. Managing complexity

and promoting health

• 7. Primary care administration and IMT

• 8. Working with colleagues and in teams

• 9. Community orientation• 10. Maintaining

performance, learning and teaching

• 11. Maintaining an ethical approach to practice

• 12.Fitness to practice

Case-based discussion

• Structured oral interview

• Designed to assess professional judgement

• Across a range of competency areas

• Starting point is the written record of cases selected by the trainee

• Will be used in general practice and hospital settings

COT/Mini-CEX

• Tool to assess consultation skills

• Based on MRCGP consulting skills criteria

• Can be assessed using video or direct observation during general practice settings

DOPS

• For assessing relevant technical skills during GP training:– Cervical cytology– Complex or intimate examinations

(e.g. rectal, pelvic, breast)– Minor surgical skills

• Similar to F2 DOPS

MSF

• Assessment of clinical ability and professional behaviour

• ST1 Rated by 5 clinical colleagues on 2 occasions; ST3 Rated by 5 clinical and 5 non-clinical colleagues on 2 occasions

• Simple web based tool

• Feedback from Clinical Supervisor

PSQ

• Measures consultation and relational empathy (CARE)

• 30 consecutive consultations in GP setting

• Central optical scanning and generation of results

• Feedback from Educational supervisor

Others

• From direct observation during training

• “tagged” against appropriate competency headings

Monitoring

• 4 monthly by Educational supervisor (trainer)

• Deanery Panel meeting at end of ST1 and ST2 • reviews the training records of every trainee • face to face review with trainees when

• unsatisfactory achievement in either of the complementary tools

• or when requested by the educational supervisor

Yearly Targets

ST1, ST2• 6 x COT or mini-CEX • 6 x CBD• 2 x MSF (not ST2)• DOPS **• Clinical supervisors’

report **

ST3• 12 x COT• 12 x CBD• 2 x MSF• DOPS ** • 1x PSQ

The Final Judgement!

• The trainer makes a recommendation as to whether the trainee has achieved competence in all 12 areas at the end of training

• Review of e-portfolio if satisfactory level achieved in training record

• Review of e-portfolio and face-to-face meeting with trainee, if satisfactory level not achieved

Group work on CBD

• Divide into groups • Think of one recent consultation you have had –

ward based/OP clinic/surgery• What competencies did you demonstrate?• What competencies could you demonstrate?• Are there scenarios that could provide

demonstration of further competencies?

Where to turn?

• Clinical supervisor

• Educational Supervisor

• Programme Directors

• Peers

• Books/internet

Take-away

• Continual assessment

• Of what we DO

• Backed up by external assessments – local and central

• Close review by Educational Supervisor

• Driven by GPST