targeting student acceptance factors to shape a successful full-scale implementation
TRANSCRIPT
![Page 1: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/1.jpg)
1ExamSoft Assessment Conference | #ASSESS2015
ExamSoft Assessment Conference
#ASSESS2015
![Page 2: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/2.jpg)
2ExamSoft Assessment Conference | #ASSESS2015
Student Acceptance
Students have a strong preference for writing on exams
Students worry about technology failures
Students acclimate rapidly to CBT
Use improves acceptance
Ease of Use is key factor in determining intent to use
![Page 3: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/3.jpg)
3ExamSoft Assessment Conference | #ASSESS2015
23% Opt out Hochlehnert et. al. 2011
Students have a strong preference for writing on exams
![Page 4: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/4.jpg)
4ExamSoft Assessment Conference | #ASSESS2015
7% Opt out Hochlehnert et. al. 2011
Students worry about technology failures
![Page 5: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/5.jpg)
5ExamSoft Assessment Conference | #ASSESS2015
Students acclimate rapidly to CBT
Sheader, 2006Increased preference with exposure
![Page 6: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/6.jpg)
6ExamSoft Assessment Conference | #ASSESS2015
Use improves acceptance
Deutsch, 2012Students endorse use after a single exposure
![Page 7: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/7.jpg)
7ExamSoft Assessment Conference | #ASSESS2015
Ease of Use is key factor in determining intent to use
Wijerathne, 201370% thought CBT was more efficient
Sheader, 200648% thought CBT was faster 37% thought there was no difference
![Page 8: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/8.jpg)
8ExamSoft Assessment Conference | #ASSESS2015
Cognitive Load Theory
Working Memory - limited Long-Term Memory - unlimited
![Page 9: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/9.jpg)
9ExamSoft Assessment Conference | #ASSESS2015
Types of Cognitive Load
IntrinsicGermaneExtraneous
![Page 10: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/10.jpg)
10ExamSoft Assessment Conference | #ASSESS2015
George Washington University SMHS
![Page 11: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/11.jpg)
11ExamSoft Assessment Conference | #ASSESS2015
Mock Quiz
Distributed at installation
Dual purpose:
Familiarize students with platform
Collect Evaluation data
Sent to 188; downloaded by 102; completed by
98
![Page 12: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/12.jpg)
12ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
10 Question Exam ReviewIn class
Familiar session format
Sent to 188; downloaded by 151; completed by
120
Post-Assessment EvaluationDistributed via Qualtrics on the same day
![Page 13: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/13.jpg)
13ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
Technology glitch
Writing on Exam
Crossing out Options
Acclimation
Preference
Exam Navigation
Software Installation
iPad-specific considerations
Eye Strain
Scrolling
Question/Direction-specific
Waiting to Start
0.00
%
5.00
%
10.0
0%
15.0
0%
20.0
0%
25.0
0%
30.0
0%
![Page 14: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/14.jpg)
14ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
![Page 15: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/15.jpg)
15ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
pre T1 T2 T3 T40
0.5
1
1.5
2
2.5
3
3.5
4
20172018
![Page 16: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/16.jpg)
16ExamSoft Assessment Conference | #ASSESS2015
Pilot Quiz
T1 T2 T3 T41
1.5
2
2.5
3
3.5
4
Comfort
![Page 17: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/17.jpg)
17ExamSoft Assessment Conference | #ASSESS2015
T1 T2 T3 T41
1.5
2
2.5
3
3.5
4
4.5
5Preference
![Page 18: Targeting Student Acceptance Factors to Shape a Successful Full-Scale Implementation](https://reader036.vdocuments.us/reader036/viewer/2022062407/55cfe48cbb61eb9f7e8b4851/html5/thumbnails/18.jpg)
18ExamSoft Assessment Conference | #ASSESS2015
Conclusions
It is possible to pre-emptively address some student concerns
Students remain sensitive to technology failures
Students perceive CBT as faster with use
Students acclimate rapidly to CBT
As students grow more comfortable, they prefer CBT