assessment tool osce ah mehrparvar,md occupational medicine department yazd university of medical...
TRANSCRIPT
![Page 1: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/1.jpg)
Assessment toolOSCE
AH Mehrparvar,MDOccupational Medicine departmentYazd University of Medical Sciences
![Page 2: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/2.jpg)
The essential components of communication skills are linked to:
Knowledge Skills Attitudes
OSCE is the “best” test that can really and effectively assess communication skills
(CS) performance
![Page 3: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/3.jpg)
HistoryOSCE was developed in Scotland
in the early 1970’sIntroduced by Dr. Harden and
colleagues in 1975
![Page 4: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/4.jpg)
Definition of OSCE: “O” stands for Objective
Every student gets the same patient (same chance)
“S” stands for Structured Several skills are tested at one time Each skill is tested in a separate station The examiner have a checklist for doing the
marking
![Page 5: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/5.jpg)
Definition, cont.
“C” stands for clinical Testing the skills of students:
Manual skills, like examining the anterior chamber of the eye
Communication skills like taking patient’s history
“E” stands for Examination
![Page 6: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/6.jpg)
Highlights OSCE is designed to assess clinical
competence and communication skills
No. of stations: 12-18 (5 min. each) Three areas have to be tested: - Communication skills - Physical examination - Short answer stations
![Page 7: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/7.jpg)
Example The student may be asked to take a
history of a young man patient (real or standardized patient) presenting with an abdominal pain
The student would be assessed according to the checklist
![Page 8: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/8.jpg)
Advantages of an OSCE:Tests the student’s ability to
integrate knowledge, clinical skills, and communication with the patient
Provides the faculty with an assessment tool that is custom-fit to the goals of a specific education program
Provides unique programmatic evaluation
![Page 9: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/9.jpg)
Advantages of an OSCE, cont. Objectivity and validity are highly ensured
in OSCE A wide range and variety of facts can be
tested at a time Contains detailed feedback for students
and teachers
![Page 10: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/10.jpg)
Disadvantages of an OSCE:ExpensiveTakes long time to construct a
case and a scoring checklistTechnical limitations
![Page 11: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/11.jpg)
Components of an OSCE
![Page 12: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/12.jpg)
The examination coordinating committee Composed from qualified members
who are devoted to the evaluative and educational process
Its responsibility is to determine the content of the examination, development, and implementation
![Page 13: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/13.jpg)
The examination coordinatorFacilitates the smooth working of
the committee in developing, implementing, and assessing the performance of the OSCE
Local site coordinator is needed if the examination is carried out in different sites
![Page 14: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/14.jpg)
List of skills, behaviors, attitudes to be assessed- The OSCE should be able to
reliably assess clinical competence in:- history taking- physical examination- laboratory, radiographic, and other
data interpretation- technical and procedural skills- counseling and attitudinal behavior
![Page 15: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/15.jpg)
Criteria for scoring the assessment Checklist should be concise, unambiguous,
and written to contribute for the reliability of the station
The more focused the checklist, the greater the power of the station to differentiate effectively among the abilities of the students
![Page 16: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/16.jpg)
The examinees Could be: student, resident, or
fellow in training or at the end of training of a prescribed course
Could be: undergraduate, graduate, or enrolled in continuing medical education program
![Page 17: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/17.jpg)
The examiners Most stations require an examiner The examiner at a station where
clinical skills (history taking, physical examination, interviewing, and communication) are assessed, may be either a physician or standardized patient
![Page 18: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/18.jpg)
Examination site Could be special part of the
teaching institutionThe examination could be
conducted in an out-patient clinic where offices are available in close proximity to each other
![Page 19: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/19.jpg)
Examination stations Generally, fewer than 10 stations is
inadequate number, and more than 25 is not practical or feasible
The time per station should be uniform as possible. It ranges from 5-20 minutes.
The skill, behavior or attitude to be tested in a station determines whether the station requires a real patient, simulated patient, lab. data, X ray film, or patient’s record
![Page 20: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/20.jpg)
Examination stations, cont. Specially constructed plastic models or
simulations may be used, e.g. rectal or breast models
Couplet station for e.g. may consist of history-physical examination combined with problem solving station
Environment of the station, should be quiet, good lighting
Clearly marked directions leading from one station to the next should be displayed
![Page 21: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/21.jpg)
Patients standardized or simulated A standardized patient is an individual
with a health problem that is in a chronic but stable condition
Simulated patients may be volunteers Both must be trained, and more
training is required for patients used in history taking than for patients used for physical examination
![Page 22: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/22.jpg)
Timekeeper, Time clock, and Time signal A well-functioning time clock, and a clearly
audible time signal are required.
![Page 23: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/23.jpg)
Contingency plans It includes reserve-standardized patients
who are trained to assume a number of roles, and a patient trainer who circulates to deal with any patient problems that arise
![Page 24: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/24.jpg)
Assessment of the performance of the OSCE It is the responsibility of the examination
coordinating committee The following points should be considered: a) The OSCE should be tested for
appropriate measurement characteristics such as: validity, reliability, feasibility
![Page 25: Assessment tool OSCE AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649e8f5503460f94b93656/html5/thumbnails/25.jpg)
Points to be considered, cont.c) A valid OSCE station measures what it
was designed to measure. A reliable station measures its consistency
d) Item analysis should be completed for an OSCE to provide indications concerning the difficulty of each station in relation to the overall exam
e) Grading can be based on a criterion- referenced system, norm-referenced system, or a combination of both