examsoft implementation at st. george’s university – a recipe for success
TRANSCRIPT
1ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Conference
#ASSESS2015
2ExamSoft Assessment Conference | #ASSESS2015
Session Title
ExamSoft Implementation at St. George’s University – A Recipe for Success
3ExamSoft Assessment Conference | #ASSESS2015
Speaker Introductions
• Sally-Ann Clement, M.Ed.– Educational Technology Specialist
• Leisha Griffith-Mark, MBA– Examinations Services Coordinator
• Teah Cummings, M.S.– Educational Technology Specialist
4ExamSoft Assessment Conference | #ASSESS2015
Contributors
• Avril Best, Ph.D.– Training Supervisor,
Educational Computing Team
• Wayne Radix, M.Sc., PMP– Project Manager
5ExamSoft Assessment Conference | #ASSESS2015
St. George’s University
6ExamSoft Assessment Conference | #ASSESS2015
History and Schools
• School of Medicine (SOM) – 2588 Students
• School of Veterinary Medicine (SVM) – 569 Students
• School of Arts and Sciences – 661 Students
• Graduate Studies – 110 Students
7ExamSoft Assessment Conference | #ASSESS2015
Project Background
Cost Reduction Reduce paper usage
Move to computer based exams
8ExamSoft Assessment Conference | #ASSESS2015
Project Background (2)
Security and integrity of exams
Easy Reporting Use of Categories
9ExamSoft Assessment Conference | #ASSESS2015
Project Management Approach to the Project
• Project plan and Schedule
• Working groups
• Communication to students
10ExamSoft Assessment Conference | #ASSESS2015
Project Management Approach to the Project
• Policies
• Pilot
• Facility upgrades
• Hiring of more proctoring staff
11ExamSoft Assessment Conference | #ASSESS2015
Project Management Approach to the Project
Executives
Champions
StudentsStaff
Faculty
Key Stakeholders
12ExamSoft Assessment Conference | #ASSESS2015
Do you use online testing
1. 2.
0%0%
1. Yes
2. No
13ExamSoft Assessment Conference | #ASSESS2015
Do you currently use ExamSoft?
1. 2.
0%0%
1. Yes
2. No
14ExamSoft Assessment Conference | #ASSESS2015
Is your institution thinking of moving to online testing?
1. 2. 3.
0% 0%0%
1. Yes
2. No
3. Already there
15ExamSoft Assessment Conference | #ASSESS2015
What is your type of institution?
1. 2. 3.
0% 0%0%
1. Two year college
2. Four year university
3. Other
16ExamSoft Assessment Conference | #ASSESS2015
What is your largest class size?
1. 2. 3. 4.
0% 0%0%0%
1. < 100
2. 100-300
3. 300-500
4. > 500
17ExamSoft Assessment Conference | #ASSESS2015
Implementation – Phased Approach
1
•Spring/Fall 2012
•Volunteers (SOM)
2
•Spring 2013
•All SOM, SVM Terms 1 & 2
3
•Fall 2013
•All SOM, All SVM, Optional SAS
4
•Spring 2014
•All SOM, All SVM, Select courses within SAS
Avg. Class Size
0100200300400500600
SOMSVMSAS
18ExamSoft Assessment Conference | #ASSESS2015
Implementation - Training
• Train the trainer program
• Training of pilot users
• Training of other users– Exam Managers, Students and Proctors
19ExamSoft Assessment Conference | #ASSESS2015
Implementation – Pilot
• Long pilot
– Volunteers
– Non high stakes exams attempted first
– Allowed for necessary modifications before go-live
– Feedback informed the process
20ExamSoft Assessment Conference | #ASSESS2015
Implementation - Customization
• System Customization• Identification of unique needs - use of university
credentials for authentication
21ExamSoft Assessment Conference | #ASSESS2015
Challenges
• Loaner laptops• Wireless connectivity• Modification of
physical facilities
22ExamSoft Assessment Conference | #ASSESS2015
Challenges (2)
• Misrepresentation of issues
• Late adopters
• Question Bank Conversion
• Timeline for Creation of Training Materials
23ExamSoft Assessment Conference | #ASSESS2015
Benefits for Faculty & Students
• Use of dynamic images
• More efficient exam creation process
• Scrambling feature
24ExamSoft Assessment Conference | #ASSESS2015
Benefits for Faculty & Students
• Reporting– Track students learning and performance– Inform course redesign based on category
performance
• Immediate results
• Ease of question feedback
25ExamSoft Assessment Conference | #ASSESS2015
Project Successes
• Implementation was completed:– Under budget – Within the allotted time period for the project.
26ExamSoft Assessment Conference | #ASSESS2015
Lessons Learned
Include Stakeholders Early
Structured Project Management
UseChampionsTraining
Support Structure
27ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• A Project Management Approach
– Keeping within the timeline
– Keeping within the budget
– Keeping stakeholders focused
– Include persons with alternative views
28ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Training
– Trainers
– Admin
– Exam Managers
– Students
– Proctors
29ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Administration
– Policies for providing access
– Careful scheduling of import processes
– Development of other policies
– Making connections with existing ExamSoft clients
30ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Exam Managers
– Champions – peer support / championing the cause
– Phased pilot
– Timely creation of exams
– Use of mock exams
– Feedback from students
31ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Successful Implementation
• Students
– Computer with minimum requirements
– Support
• Academic Orientation
• Online Support/Documentation
• Walk-in Support
– Download exam ahead of scheduled sitting
32ExamSoft Assessment Conference | #ASSESS2015
• ExamSoft Champions 2012- Helping Others
• Three faculty members awarded for their selfless contribution – assisting and encouraging their peers through the implementation process
• Awarded an iPad mini from ExamSoft
Highlight!
33ExamSoft Assessment Conference | #ASSESS2015
Guidelines for Implementation
Discovery Activity• Discuss additional guidelines which resulted in
successful implementation at your institutions.• What are some implementation challenges you
anticipate and how would you overcome them?
Report
In 1 minute or less, share the most important discovery made during the discussion.
34ExamSoft Assessment Conference | #ASSESS2015