• Introduction of 2nd pass criteria for OSCE May 2015, and its implication (5 min)• Revised assessment of MBBS, and its implications (10min)• Match process (5 min)• Switch option • IELTS issues (5 min)• Returning students from PMS (5 min)• Proposal for future Academic Council meetings and visits from

PMS/PDS (5-10 min)• Discussion

• Pass mark for each station is generated by the Borderline Method.

• Currently, students need to achieve an overall mark in excess of the average of the individual station pass mark in order to pass the OSCE. (First Criteria)

Pass Criteria for OSCE

Second Pass Criteria for OSCE(cohort ME1/13)

Students must pass a minimum of any 10 stations out of 16 stations (62%)

in addition

to achieving an overall mark in excess of the average of the individual station pass mark (First Criteria) in order to pass the OSCE

Data from Previous Cohorts

Only one criteria (No. of students)

Applying both criteria (must pass min 10 stations)

Cohort 95E1

2 1% 10 5.2%

Cohort 98E1 4 2.2% 19 10.6%

Cohort 102E1

2 0.9% 13 5.6%

Cohort 106E1

19 9.7% 38 

19.5%

Cohort 108E1

11 4.7% 30 12.9%

Remediation

• Borderline and weak students identified from performance in Sem 2 OSCE (fail >2/10 stations)

• At least 8 remedial sessions throughout sem 3 and 4

(45-56 students in ME1/13 and ME2/14)

Implications for 2nd criteria for OSCE pass criteria

• Higher failure rate (5-20%)(?effect of remediation)

• Last minute loss of transfer students known only after sem 5 exams

(June/Sept 2015 and Nov/Feb 2016)

• PMS will be informed asap (Balance of residual numbers for next match)

Revised AssessmentFeb 2015 – June 2017

(ME1/15)

Transition ME2/14Transfer Feb 2017

IMU Learning Outcome Domains

• Application of basic sciences in the practice of the profession

• Psychomotor skills

• Communication skills

• Critical thinking, problem solving and research

• Disease prevention & health promotion

• Family and community issues in health care

• Self-directed lifelong learning with skills in information and resource management

• Professionalism, ethics and personal development

Draft 10.11.14     

Assessment of Application of basic sciences in the practice of the profession, Inc patient safety 

 

Assessment of Psychomotor skills & Communication skills Inc patient safety 

Assessment of Disease prevention & health promotion and Family and community issues in health care Inc patient safety 

 

Assessment of Critical thinking, problem solving and research & Self-directed lifelong learning with skills in information and resource management 

 Assessment of Performance in Clinical Placements, inc Professionalism Inc patient safety 

  Method and tools 

  Numerical score 

   Numerical score 

 Project with Written assessment (Assignment) 

   

 Critical appraisal and written assignment 

     

Log book  case reports Global assessment of knowledge and competences    Professionalism 

Sem 1 - 3

SBA

OSCE

Comm Orientated Project

Professionalism

PPD reflection Patient Safety

- (submission mandatory )

Sem 4- 5

SBA and EMQ

OSCE

Comm Health Survey

Critical Appraisal

and Dissertation

Resubmission for students who are unsatisfactory

Professionalism

Case report and presentation Ethics Course

BLS

(submission mandatory )fprofessionalism)

Sem 6 – 7

SBA and EMQ

OSCE Professionalism

Log book Case summaries and report Structured Clin Assessment

Sem 8-9

SBA EMQ SAQ

and MEQ

OSCE

Research Project

and Dissertation

Professionalism Log book

Case summaries and report Structured Clin Assessment

Sem 10

TBC)

CFCS assessment

1. Portfolio 2. Mandatory pass to

enter progression point assessment.

Portfolio

Assessment of Application of Basic Sciences and Clinical Sciences in the practice of the profession, Including patient safety 

  

Semester  

OBA  

EMQ  

WEIGHTING TIME 

1  60  0  10%  75 min   

2 

Assessment of Sem 1 and 2  90 (20/sem 2 module + 30 fr Sem 1 and comm health) 

   No EMQs 

   30% 

   110 min 

   

3 

Assessment of Sem 2 and 3  180 (20 OBA/ Sem 2 module and 35 OBS/ Sem 3 Module) 

    No EMQs 

    60% 

     110  min  + 110min 220 min 

  Progression Point 1    100%  405 min   

4 

Assessment of Sem 4  75 (25 OBA / module ) 

   3 EMQ (formative) 

   30% 

   90 min  +15min 

        

5 

Assessment of Sem 2, 3, 4 and 5 

 120 (15 OBA/ sem 4 module 25 OBA/ sem 5 module) includes community health, ethics 

 16 (sem 2-5) 1-2 EMQ/ sem 2-4 modules 

 *tests 

integration  

 

   70% 

 2 papers 110 + 120 min 230 min 

  Progression Point 2    100%  320 min + 15min  

Assessment of Psychomotor skills & Communication skills, Including patient safety 

Semester Type of assessment Method Format Time

2 Formative OSCE 4 stations 20 min

  

3

Assessment ofSem 1, 2 and 3 Summative

 OSCE

 10 Ten  5-min stations

 50min

  Progression Point 1   100% 50 min + 20 min

   

5

Assessment of Sem 2-5 Summative

   OSCE

 15 Eight  (8) 5-min stationsAndSeven (7) 7-min stations

   89min

  Progression Point 2   100% 89min

Assessment of Disease prevention & health promotion and Family and community issues in health care

Semester    1      

 2

  Comm Orientated  Project Written assessment  (Assignment)

 

3

  Resubmission for students who areUnsatisfactory.

Satisfactory grade isMandatory for entry to OSCE and Sem 5 written 

assessment

 

  Progression Point 1     

4   Comm Health Survey Project with Written assessment(Dissertation with data analysis and lit re)  

 

5  

Resubmission for students who areUnsatisfactory.

 Satisfactory grade isMandatory for entry to OSCE and Sem 5 written 

assessment

 

  Progression Point 2      Progression Point 5    

Assessment of Assessment of Critical thinking, problem solving and research & Self-directed lifelong learning with skills in information and resource management

Semester     Grade

1      

2      

3Critical appraisal with journal club –mandatory participation    

  Progression Point 1    

4Critical appraisal and writtenassignment (2000 -3000words)* Submit week 6 of semester 4

5Resubmission for students who areunsatisfactory*

Satisfactory grade isMandatory for entry to OSCE and Sem 5 written assessment

Resubmission capped at 50%

  Progression Point 2   100%

Assessment of Performance in Clinical Placements, including Professionalism and Patient Safety 

Semester 

Attendance Professional behavior And Other

professionalism considerations

 Clinical placement performance and Mandatory assignments

1>80%      - Satisfactory

75-79% - Cause for Concern <75%   - Unsatisfactory

No unsatisfactory behavior or conduct

        

PPD reflection report

     Patient Safety reflection report2

3

 Progression Point 1

   

4

>80% - Satisfactory75-79% - Cause for Concern

 <75% - Unsatisfactory

 

No unsatisfactory behavior or conduct    Online ethics course

Case report and presentation

BLS

5

 Progression Point 2

   

Implications of revised assessment

for match and transfer• Match after 1st Progression point (sem 3) takes place in early semester 

4

• Students who fail sem 3 may not enter the match, repeat semester 3 and take 2nd attempt of exams after a semester of remediation.

• Students matched in sem 4 will not transfer as planned if they fail Progression point exams in Sem 5 (last minute withdrawal of students, as at present)

MATCHING PROCEDURE &

PROCESS

Matching Process:PMS-UG

Dean’s Briefing on PMS-UG

Mentors fill in Student

Attributes Form

Students fill in:Form A

ECA FormNarrative Form

To inform students

Given to PMSs to rank (except for Form A)

Compilation of result sem 1 – sem 3

Form A: Students’ Ranking

Matching Process Endorsement

To Inform PMS

Semester 4 & 5 results

•Matching Process with new assessment:

*The Balance of places will be given to students who fail sem 5 from

the previous cohort and also open for those who want to switch to go to PMS.

Sem 5Sem 4

Finish in June 2017Transfer to PMS: Sept 2017 (UK/

Ireland), Jan 2018(Aus), May 2018 (Canada & USA)

Sem 3

Students are matched

Sem 5 results are released

Students who fail sem 5 will repeat

Sem 3 Sem 5Sem 4

Balance of places *

Students are matched

Finish in Nov 2017Transfer to PMS: Jan 2018 (Aus),

May 2018 (Canada & USA), Sept2018 (UK/Ireland)

Re rank

rematchSem 5 results are released

ME115

ME215

Feb – Jul 2016

Aug – Nov 2017

Aug – Feb 2017

Aug – Dec 2016 Feb – Aug 2017

Feb – Jun 2017

Implications of PMS-UG Match in early Sem 4 • At least 24 weeks between known matched place and transfer

• Enhanced programme of preparation for transfer

• Country-specific programme offered by IMU or PMS(eg USMLE prep for US-bound students)• Cultural preparation• Mentoring by senior students• Self-preparation by students

Matching Process:PMS-G:

Dean’s Briefing on PMS-G

Mentors fill in Student

Attributes Form

Students fill in:Form A

ECA FormNarrative Form

To inform students

Given to PMSs to rank (except for Form A)

Compilation of result sem 1 – sem 5

Form A: Students’ Ranking

Matching Process Endorsement

To Inform PMS

Bmed Sc results

Implications of PMS-G Match in after Sem 5 • All matched students would have passed entire Phase 1 (no last

minute dropouts)

• Students will undertake 1 year of BMedSc and research prior to transfer

• All BMedSc students will take part in peer tutor scheme, and keep up clinical and communication skills at least 2h each week for at least 20 wks

MOVEMENT OF SWITCH OPTION

SUMMARY OF MOVEMENT OF SWITCH OPTION FROM 2013

UNTIL MARCH 2015

YEARMBBS-IMU

to PMS-UG

MBBS-IMU to PMS-G

PMS-G to PMS-UG

PMS-UG to PMS-G

PMS-UG to MBBS-

IMU

PMS-G to MBBS-

IMU

MBBS to BMED SC

Total/year

2013 2 5 NIL NIL 8 1 1 172014 6 5 2 1 34 NIL 1 492015 5 1 7 13

TOTAL 13 10 2 2 49 1 2 79

REASONS WHY STUDENTS SWITCH FROM PMS-UG TO IMU-

MBBSYEAR IELTS % OTHERS %

2013 2 0.97 6 2.91

2014 23 11.22 11 5.37

2015 6 7.79 1 1.29

TOTAL 31 18

REASONS WHY STUDENTS “FAIL” THEIR IELTS (2014 - MARCH

2015)

YEAR LISTENING READING WRITING SPEAKING WRITING & SPEAKING

WRITING & OTHERS TOTAL

2014 NIL NIL 8 6 8 1 23

2015 NIL NIL 3 2 1 NIL 6

TOTAL NIL NIL 11 8 9 1 29

IELTS• IELTS requirement for transfer (from 2014)7.0 overall with at least 7.0 in all components at a single sitting

• IELTS requirement for entry to IMU (from 2013)7.0 overall with at least 6.5 in all components at a single sitting

IELTS requirement for transfer (before 2013)7.0 overall• IELTS requirement for entry to IMU (before 2013)7.0 overall

IELTS and language supportIELTS at entry known- “low” performing students directed to language support

IELTS validity 2yrs

- 1st IELTS submission – week 14 of semester 3- Language support for students from for 20-26 wks, before final

match results, and final submission of IELTS results (at least 20 wks before transfer)

Returning Students from PMS

Proposal for Biennial Academic Council Meetings

Remit of Academic Council

• To provide advice and recommendations on matters pertaining to the admissions process, curriculum and its delivery, assessment and faculty appointments and development, as well as research and postgraduate training

• To monitor and help evaluate the implementation of the IMU medical and dental curricula, especially that of phase 1

• To provide advice on the method of transfer and monitor the transfer of students to all the partner schools 

• To monitor student performance at both the IMU and the partner schools and to provide regular feedback to the IMU on student progress at all the partner schools.

Proposal

• Biennial Academic Council Meetings

• Intervening Biennial visits

Full 3 day AC - alternate years

Purpose• To fulfil full remit of AC, inc QA• Discuss specific and current issues• Meeting IMU staff and students• Education and exchange

• Plus ½ day debrief for Regional Reps of Caucases ie total 3.5days 

Full 3 day AC - alternate years

Attendance

• Chair• Deputy Chair• All PMS and PDS members/representatives

Visits - alternate yearsPurpose• Discuss specific and current issues, related to continent/country and 

IMU• Interaction between PDS and PMS with IMU staff and students

• No QA function• No specific education function  

Duration •  1-  1 ½ days

Visits - alternate years

Attendance • AC Chair and Deputy Chair  (all visits)• Caucas reps (all visits)• PDS members  (all visits)• Members of UK/Ireland (n=15-17) or Australia/North America (n=11-

12) PMSs alternate years

• New PMSs will attend each time, for 1st 4-5 years

Other forms of Interaction between PMS and IMU• External Examiner (Semester 3 / 4 and Semester 5 )  4 times a yearVisits 7-10 days

• Visiting Lectureships 2 times a year 3-6 weeks

• Ad Hoc visits

Draft Time-table 2015-2022

  AC(Full – 3 or 3 ½ day)

Visits1-1 ½ days)

Ext ExaminerSem 3/4 July

Ext ExaminerSem 3/ 4 Jan

Ext ExaminerSem 5 May

Ext ExaminerSem 5 Nov

VL 1 VL 2

2015 2-day - T Sampson (Soton)

R McMahon(Manchester)

M Catchpole(UTAS)

A Freeman (Exeter)

G Loftus(Galway)

T Marie(Dalhouise)

2016 - PDS and PMS/UK and Ireland

UK/Ireland Aus/NA UK/Ireland UK/Ireland   J Le Blanc(Dalhouise)

2017 3-day - UK/Ireland UK/Ireland Aus/NA UK/Ireland UK/Ireland Aus/NA

2018 - PDS and PMS/ Australia and N America

Aus/NA UK/Ireland UK/Ireland UK/Ireland UK/Ireland Aus/NA

2019 3-day - Aus/NA UK/Ireland UK/Ireland UK/Ireland UK/Ireland Aus/NA

2020 - PDS and PMS/UK and Ireland

UK/Ireland UK/Ireland Aus/NA UK/Ireland UK/Ireland Aus/NA

2021 3-day  - Aus/NA UK/Ireland UK/Ireland UK/Ireland UK/Ireland Aus/NA

2022 - PDS and PMS/ Australia and N America

UK/Ireland UK/Ireland Aus/NA UK/Ireland UK/Ireland Aus/NA

Thank you

Time Line for Matching Process

1PMS will be sent Transfer Information Form Week 22 of sem 2  PMS to reply with Transfer Information Form 1 week before sem 3 begins

 

 DEAN'S BRIEFING ON PMS, students notified to complete forms, Student Info Transfer is published in the portal

Week 4 of sem 3

  Students to return the Forms Week 2 of sem 4 

3Results compiled after EOS3 tentatively 3rd week of July

  Obtain academic transcripts, mean graph and IMU ranking (4 weeks process) 4 weeks after EOS3 is out

  Details of students sent to PMS for ranking Week 3 of sem 4  Received ranking by PMS Week 7 of sem 4

 4MATCHING PROCESS OCCURS Week 8 of Sem 4

  Meeting to endorse the matching result (with Dr Mei Ling) Week 9/10 of sem 4  Release Matching Results to students via letter Week 11 of sem 4  Release Matching results to PMS Week 13 of sem 4

 6Compile EOS 5 Tentatively 3rd Week of June

  Transfer list is reviewed for any failures First week of July  Inform PMS on the updates First Week of July

 7Students transfer to their respective PMS  

Time line for PMS-G ME2/14 ME1/15Action based on Revised SOP G G

1PMS will be sent Transfer Information Form Mid-Jan 2016 Mid-June 2016  PMS to reply with Transfer Information Form Mid-Feb 2016 Mid- July of 2016  Transfer Information collated 3rd Week of Feb 2016 3rd week of July 2016

 

 DEAN'S BRIEFING ON PMS, students notified to complete forms, Student Info Transfer is published in the portal

week 4 of sem 4 week 4 of sem 4

  Students to return the Forms week 4 of sem 5 week 4 of sem 5 

3Results compiled after EOS3 tentatively 2nd/3rd week of Jan tentatively 3rd week of July

 Obtain academic transcripts, mean graph and IMU ranking (4 weeks process)

4 weeks after EOS3 is out 4 weeks after EOS3 is out

  Results compiled after EOS 5 tentatively 3rd/4th week of Nov tentatively 2nd/3rd week of Jun  Obtain sem 5 results 2 days after EOS5 is out 2 days after EOS5 is out  Details of students sent to PMS for ranking First week of Dec First week of July  Received ranking by PMS Second week of Dec Second week of July

 4MATCHING PROCESS OCCURS Third week of Dec Third week of July

  Meeting to endorse the matching results Third week of Dec Third week of July  Release Matching Results to students via letter Week 2 of BMed Sc Week 2 of BMed Sc

   Release Matching results to PMS Week 3 of BMed Sc Week 3 of BMed Sc

 6Compile Bmed Sc Results 2 days after VIVA 2 days after VIVA

  Inform PMS on the results Week 43 of BMed Sc Week 43 of BMed Sc 

7Students transfer to their respective PMS Jan 2018 /Sept 2018 Sept 2018 /Jan 2019