the multiple mini-interview caahp 2012 ellen hughes denise maciver
TRANSCRIPT
The Multiple Mini-Interview
CAAHP 2012
Ellen Hughes
Denise MacIver
MMI Presentation Outline
• Multiple Mini Interviews (MMIs):– Why? What? Who? How?
• Interactive Sessions– Training– Rotations (35 minutes)– Debriefing
• MMIs by Distance – Can it work?• Q & A
Why? Benefits of the MMI
The MMI is an innovative, feasible, acceptable, and reliable interview technique that is:
• Assess different non-cognitive attributes
• Reliable and valid
• Less biased/more defensible than traditional panel interview
• Designed to reflect the values of the profession
• Multiple first impressions
• Ability to interview a large number of applicants in less time
with less resources
MMI
• Non-cognitive qualities of an individual
• Formats: Discussion, Collaborative or Acting.
• Applicant reads a question ( 2min), enters a room, answers the question (5-10 min), leaves room and repeats at next station.
• 6 – 10 questions
MMIs: Multiple First Impressions
What? Assessing Non-Cognitive Abilities
The MMI assesses Non-Cognitive abilities such as:
• Teamwork
• Responsibility
•Ethical & moral judgment
•Communication skills
•Management skills
•Problem solving
•Self awareness
•Conflict resolution
•(Career Investigation)
MMIs: Who?Interviewers and Candidates
Station 1
Station 2
Station 3
Station 4
Station 5
Station6
Station 7
Station 8
Candidate
Collecting Room
IIIIIIII
A B C D
E F G H
Interviewers are trained shortly before the interview day.
On Interview Day:
Candidates are gathered in one room for orientation/training
Interviewers receive their packages, see questions for the 1st
time and are shown their rooms.
MMIs: How? Interviewers and Candidates
Station 1
Station 2
Station 3
Station 4
Station 5
Station6
Station 7
Station 8
IIIIIIII
Candidate’s First Scenario Question
2 minutes outside the room reading the question; 5 minutes in the room.
8 Station Circuit
A buzzer sounds at 2 minutes (reading question),
4 minutes & 30 seconds (wrap up),
then again at 5 minutes (leave room, move to next station)
A B C D E F G H
Rotation of Candidates
Station 1
Station 2
Station 3
Station 4
Station 5
Station6
Station 7
Station 8
IIIIIIII
A B C D E FG H
Candidates Next Scenario Questions
Candidates continue to rotate through the rooms (stations).
Candidates have 2 minutes to read the questions outside the room and 5 minutes to answer the questions in the rooms.
Interviewers do not move.
Candidates move.
A buzzer sounds at 2m, 4m30s, 5m each time
Example Rotation for 1 Interviewer (1 station)
Start Time
End Time Applicant – Question
8:30 8:37 1st Candidate
8:37 8:44 2nd Candidate
8:44 8:51 3rd Candidate
8:51 8:58 4th Candidate
8:58 9:05 5th Candidate
9:05 9:12 6th Candidate
9:12 9:19 7th Candidate
9:19 9:26 8th Candidate
9:26 9:33 Break
An example of what it will
look like for one
interviewer…
8 interviews/hr
• 48 interviews per 6 hr-
day
With 8 interviewers how
many interviews per day?
MMI
• Non-cognitive qualities (decision making, ethical judgment, inter-professional skills).
• “Discussion” Format – 1 interviewer to 1 candidate
• Candidate reads a question (1 min), enters a room, answers the question (4 min), leaves room and repeats at next station.
• 3 questions
CAAHP MMIs: 3-Station Circuit
CAAHP 2012 Simulated MMIs:3 Station Circuits – 5 minutes each
I I I
Time A A A
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
5 minutes to Switch Roles
I I I
Time B B B
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
I I I
Time C C C
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
I I I
Time D D D
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
Training: Role of the Candidate
• Prior notice of MMI style of interview• Orientation/Training on Day of Interviews• Review your schedule• Move when the bell rings• You have 1 minute to read the question (bell will ring
after 1 minute)• You can make notes while you read the question• You have 4 minutes to answer the question (warning
bell will ring after 3m, 30 secs (wrap up), then at 4 minutes – time to move to next station)
Training: Role of the Interviewer
• Confirm that the correct candidate enters the room – they will give you a label with their name to put on your score sheet
• Confirm no conflict of interest
• Ask the candidate if they have read the question
• Ensure a fair but rigorous opportunity for the applicant to meet the criteria for the station
Role of the Interviewer…cont.
• Remain objective and do not provide feedback or in any way divulge an opinion of the performance of an applicant
• Do not read the question or clarify the question for the applicant – the question is posted for the candidate
• Provide a considered and justifiable score at the station using the entire scale of ratings for each group of candidates
Scoring
• For the first couple of candidates, you may wish to make notes and score them on a separate piece of paper. Once you get a feeling for the question, you can transfer the scores to the score sheets.
• You CAN change scores you’ve given candidates who have come and gone from your room.
Score Sheet
• Record only negative comments – keep it professional (forms are FOIP-able)
• Use the entire grading scale!• No half marks – only whole numbers• Use check mark to score (not x’s, lines, or
circles)
Interviewer Package
Items included:– Your Scenario question– A supporting document to assist you with the question– Score sheets
– Candidate Rotation Schedule– List of Candidates
– Pencil & eraser, notepaper
CAAHP 2012 Simulated MMIs:3 Station Circuits – 5 minutes each
I I I
Time A A A
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
5 minutes to Switch Roles
I I I
Time B B B
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
I I I
Time C C C
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
I I I
Time D D D
3:15 – 3:20 1 2 3
3:20 – 3:25 3 1 2
3:25 – 3:30 2 3 1
• Experiences as a Candidate?
• Experiences as an Interviewer?
• Other?
Debriefing
Validity of videoconferencing for entrance
interviews
(not yet published)
Dr Randy W. Dreger
Heather Gray, BSc, Chair-Diagnostic Laboratory & Medical Transcription
Joy Lutz, CLXT, Instructor-Combined Laboratory & X-Ray Technology.
Denise MacIver, M.Ed., Associate Dean-SHS
Ellen Hughes, M.Ed., Dean-SHS
Scott Paradis, CPT, Research Assistant-SHS
Technical Support
Troy Gregoire, School of Information Communications and Engineering
Background
• Interviewing applicants has been and remains an important part of the selection process.
• Typically done in a face to face environment
• Not always feasible
• New technology may ameliorate this issue
Validity of videoconferencing for entrance interviews
Problem
•ProFitHR a private company who specializes in the interview process were
looking to determine if their product the MMI could be performed via Skype
and produce valid results.
Validity of videoconferencing for entrance interviews
Research Design
•23 NAIT students (no MMI experience)
•Cross over design
•10 stations
Validity of videoconferencing for entrance interviews
Day 1 Day 2
Results
• F2F - 6.2 ±1.5.
• Skype - 6.1 ±1.8
• no significant difference between the scores
Validity of videoconferencing for entrance interviews
0
2
4
6
8
10
skype total/10 F-F total/10
Results
• Compared to the F2F condition the applicant ranking on Skype:
• 2 no change
• 12 did better
• 9 did worse
• suggesting no systematic difference
• A secondary question was to determine if there was a day to day or learning effect. The scores for day 1 were 5.9
out of 10 and day 2 was 5.8 out of 10, no significant difference
Validity of videoconferencing for entrance interviews
Results
• Seventy percent of the applicants preferred the F2F method while 17% preferred Skype and 13% liked either method
equally.
• The interviewers also preferred the F2F method (70%) with 30% choosing either.
• When asked about performing the MMI in the future 52% of applicants would prefer F2F, 13% Skype and 35% would use
either.
• Interviewers’ responses were 30% F2F, 10% Skype and 60% either.
Validity of videoconferencing for entrance interviews
Future Projects
•Replicate the study with a large and more diverse sample.
•Replicate this study in a “non-laboratory” setting.
Validity of videoconferencing for entrance interviews
Thank You! Questions?