integrating virtual reality with use-of-force training ... · v abstract this project identifies...
TRANSCRIPT
University of New OrleansScholarWorks@UNO
Senior Honors Theses Undergraduate Showcase
5-2017
Integrating Virtual Reality with Use-of-ForceTraining SimulationsTed MaderUniversity of New Orleans
Follow this and additional works at: http://scholarworks.uno.edu/honors_theses
This Honors Thesis-Unrestricted is brought to you for free and open access by the Undergraduate Showcase at ScholarWorks@UNO. It has beenaccepted for inclusion in Senior Honors Theses by an authorized administrator of ScholarWorks@UNO. For more information, please [email protected].
Recommended CitationMader, Ted, "Integrating Virtual Reality with Use-of-Force Training Simulations" (2017). Senior Honors Theses. 87.http://scholarworks.uno.edu/honors_theses/87
INTEGRATINGVIRTUALREALITYWITHUSE-OF-FORCETRAININGSIMULATIONS
AnHonorsThesis
Presentedto
theDepartmentofComputerScience
oftheUniversityofNewOrleans
InPartialFulfillment
oftheRequirementsfortheDegreeof
BachelorofScience,withUniversityHighHonors
andHonorsinComputerScience
by
TedMader
May2017
ii
TableofContents
ListofFigures..............................................................................................................iv
Abstract.......................................................................................................................v
Introduction................................................................................................................1
Motivation..................................................................................................................1
IntroducingVirtualReality.......................................................................................3
RelatedWork..............................................................................................................3
HardwareandTools....................................................................................................4
HTCVive..................................................................................................................5
Headset.......................................................................................................................5
Unity........................................................................................................................6
DevelopmentProcess..................................................................................................7
BuildingtheModule................................................................................................7
ModificationstoSimulation.....................................................................................8
SimulationWalkthrough........................................................................................10
Evaluation.................................................................................................................12
ExperimentalDesign..............................................................................................12
PresenceSurveys...................................................................................................12
EmpaticaE4...............................................................................................................14
Risks..........................................................................................................................14
TestingProcess.........................................................................................................14
iii
Hypotheses...............................................................................................................15
SurveyData...........................................................................................................15
PhysiologicalData..................................................................................................16
Results......................................................................................................................16
Discussion.................................................................................................................19
Conclusion.................................................................................................................20
Bibliography..............................................................................................................22
Appendix1:PresenceQuestionnaire.........................................................................24
Appendix2:IntroductionVideoScript.......................................................................25
Appendix3:ScreenandKeyboardChecklistandVerbalQuiz.....................................27
GeneralGuidelines.................................................................................................27
Step-by-StepChecklist...........................................................................................27
VerbalQuiz............................................................................................................28
Appendix4:VirtualRealityChecklistandVerbalQuiz................................................29
GeneralGuidelines.................................................................................................29
Step-by-StepChecklist...........................................................................................29
VerbalQuiz............................................................................................................30
iv
ListofFigures
Figure1.Avirtualenvironmentinthepoliceuse-of-forcetrainingsimulation.................2
Figure2:HTCViveaccessoriesincludeddiagram..............................................................5
Figure3.Diagramoftransformationstopoliceuse-of-forcesimulationbythevirtual
realitymodule....................................................................................................................8
Figure4.Filestructurediagramofvirtualrealitymodule..................................................8
Figure5.Anoverviewofthevirtualenvironmentforthescenario...................................9
Figure6.Dialogueguidesusershowtointeractwithvirtualcharactersandusethegun.
..........................................................................................................................................10
Figure7.Thepoliceofficerinteractswiththesuspect,andthesuspectattacksusinga
knife..................................................................................................................................11
Figure8.Aquestionfromthesurveytocomparethetypesofcontrols.........................13
Figure9.Resultsfrompositivequestions........................................................................17
Figure10.Resultsfromnegativequestions.....................................................................17
Figure11.PhysiologicaldatafromtheEmpaticaE4wristbandforeachparticipant.......18
Figure12.Resultsfromnumbersofparticipantswithsupportingphysiologicaldata.....18
v
Abstract
Thisprojectidentifiesimprovementstopresenceandimmersioninasimulation
byintegratingvirtualrealitytechnology.Thissimulationprovidesavirtualenvironment
fortrainingpoliceofficersintheuseofforcewhenresolvingpotentiallydangerous
situations.WeintegratetheHTCVivevirtualrealitysystemwithapreviouslydeveloped
prototype3Dvirtualenvironmentthatusesartificialintelligencetechniquesfor
generatingnarratives.Theinteractionsmadepossiblewithvirtualrealitytechnology
provideaneffectivealternativetotraditionalmouseandkeyboardinput,andthey
evokefeelingsinusersthattheeventsareactuallyoccurringandreacting.Our
hypothesispredictsthatusersexperienceagreatersenseofpresencewhenusingvirtual
realityhardwaretointeractwiththesimulation.
Keywords:computerscienceandtechnology,virtualreality,presence,HTCVive
1
Introduction
Thisprojectinvolvesdevelopingahighlyimmersiveinteractivetrainingsimulationbuilt
withcuttingedgecommercialvirtualreality(VR)technology.Thissimulationprovidesavirtual
environmentintendedtotrainpoliceofficersintheuseofforcewhenresolvingpotentially
dangeroussituations.Thepreviousiterationofthissimulationconsistedofaprototype3D
environmentthatplayersviewedonamonitorandcontrolledviamouseandkeyboard.Virtual
realitytechnologyallowsthedevelopmentofanenvironmentthatwillfurtherengageusers.
Providingincreasedrealismimproveseffectivenessofthepoliceuse-of-forcetraining
simulation[1].Thisisaccomplishedbybringingthetrainingsimulationintovirtualrealityby
integrating:
• Ahead-mounteddisplaythatallowsuserstolookaroundatanypartofthevirtual
environmentbyheadmovements.
• Wirelesshandheldcontrollersthatallowuserstointeractwithobjectsinthevirtual
environmentbyhandmotionsandroom-scalemovement.
Improvementsbroughtbytheseintegrationsweremeasuredusingsubjectiveandobjective
metricsforpresenceandimmersion,whichareemergingasstandardmeasuresofthe
effectivenessofVRexperiences[2,3,4].
Motivation
Interactivevirtualenvironmentsprovideusersasettingforexploration,interaction,
learning,andexperiencingconsequences.Thissafeandengagingcontextcanbeutilized
2
effectivelyineducationandtraining[5,1,6].Forourpurposes,weleveragedvirtual
environmentsfortrainingnewpoliceofficersinusinganappropriatelevelofforcewhen
resolvingpotentiallydangeroussituations.
Figure1.Avirtualenvironmentinthepoliceuse-of-forcetrainingsimulation.
Theprototype3DvirtualenvironmentdevelopedbythePIandcomputerscience
graduatestudentsleveragesartificialintelligencetechniquesforadaptationandpersonalization
ofthevirtualenvironment’snarrative,basedonuserbehavior.Thesetechniquesrelyon
algorithmicsolutionsforgeneratingandadaptingstructureforeffectivenarratives.Allowing
participantstotaketheroleofacharacterandengageinandconstructnarrativewithvirtual
agentsthroughtheiractionsenhancesagencyinthevirtualenvironment[7].However,this
prototypeusesconventionalkeyboardandmouseasinputdevicesandamonitorfordisplay,
anditseffectivenesscouldbeimprovedwithvirtualrealitytechnology.Allowingauserto
interactusingtheirhead,hands,andfeetwouldimprovethevirtualenvironment’sabilityto
3
generateafeelingofpresence–thesubjectiveexperienceofbeinginadifferentenvironment
thanone’scurrentrealworldlocation[2,3,8].
IntroducingVirtualReality
Companieshaverecentlybeendevelopingaffordable,widely-availablevirtualreality
hardware.Thetechnology’spotentialrisesasbusinessescontinuetoaggressivelyinvestin
virtualrealityhardwaredevelopment.Furthermore,existingsoftwaretoolsalloweasy
integrationofthehardware,providinganopportunityforbuildingonthepoliceuse-of-force
trainingsimulation.
Afterintroducingahead-mounteddisplayandwirelesshandheldcontrollerstothe
existingsimulation,astudywasconductedtocomparetheabilityofVRtechnologytoinvoke
feelingsofpresenceandengagementagainstthatoftraditionalinputdevices.Thestudy
measuredtheseabilitiesusingestablishedsubjectiveandobjectivemetricsduringthe
evaluationofthesimulation’seffectiveness[3,4].
RelatedWork
Simulationsareaneffectivemethodofpreparingprofessionalsforhighlycomplex
workingenvironments[1].Digitaltrainingsystemsprovidecost-effectivesolutionsforpreparing
business,academia,industry,andmilitarypersonnelforfunctioninginreal-worldscenariosthat
aredifficulttoreplicateinaclassroomenvironment[6].However,theeffectivenessofvirtual
realitysimulationsdependsontheirabilitytoelicitingrealisticbehaviorinusers.Slater
identifiestwoimportantfactorsforinfluencingrealisminvirtualrealitysimulations:plausibility
illusionandplaceillusion[8].
4
Evokingfeelingsinusersthattheeventswithinthesimulationareactuallyoccurringand
reactingtotheusercreatesplausibilityillusion.Artificialintelligencetechniquesforgenerating
narrativesareutilizedtoimproveplausibilityinthepoliceuse-of-forcetrainingsimulation[9].
Creatingthesenseofbeingactuallypresentinthevirtualenvironmentattributestoplace
illusion,whichwewillrefertoaspresence[6].Thisprojectfocusesonimprovingpresencein
thesimulationbyprovidingamoreconvincingenvironmentusingvirtualrealitytechnology.
HardwareandTools
Beforetherecentmassiveresurgenceofvirtualrealitytechnology,fordecades,previous
attemptsatcreatingcommerciallysuccessfulvirtualhardwarehavefailed[10].Thesefailures
havebeenattributedtoproblemssuchashighcosts,lackofcompatiblesoftware,andmotion
sicknessinusers.However,sinceOculus’ssuccessfulcrowd-fundingoftheirRiftvirtualreality
headsetonKickstarter,businessessuchasGoogle,Facebook,Microsoft,Sony,HTC,and
Samsunghavebegunaggressivelyinvestingintheresearchanddevelopmentofvirtualreality
technology.Thishasledtothereleaseofseveralaffordable,widelysupportedvirtualreality
systems.
5
HTCVive
TheHTCVive1isavirtualrealitysystemdevelopedbyHTCandValveCorporation.It
allowsuserstointeractwithvirtualworldsasthemselves,ratherthanacharacterintheworld.
TheHTCVivebundleincludesavirtualrealityheadset,twowirelesshandheldcontrollers,and
two‘Lighthouse’cameras.Theheadsetcontainsscreensforeacheyeandsensorsformotion
tracking.Eachcontrolleriswirelessandbatterypowered,allowinguserstointeractwiththe
virtualworldusingamulti-functiontrackpad,dual-stagetrigger,gripbuttons,andmenubutton.
Twowirelessinfrared“Lighthouse”camerasperformmotiontrackingfortheVivevirtualreality
system.Theseareideallyplacedincornersoftheroom,andfollowatotalof70infrared
sensors.Thecompletekitcontainsnineteentotalitems:
A. ‘Lighthouse’camerasB. SyncCableC. Basestationpoweradapterx2D. MountingkitE. LinkboxF. LinkboxmountingpadG. LinkboxpoweradapterH. HDMIcableI. USBcableJ. EarbudsK. AlternatefacecushionL. CleaningclothM. DocumentationN. Headsetwith3-in-1,audiocablesO. Controller(withlanyard)x2P. MicroUSBchargerx2
1“VIVE™|DiscoverVirtualRealityBeyondImagination,”https://www.vive.com/us/
Figure2:HTCViveaccessoriesincludeddiagram
6
Headset
TheHTCViveheadsetcontainsa1080×1200,90Hzscreenforeacheye,havingenough
pixeldensitytopreventthescreendooreffect,i.e.,linesseparatingpixelsbecomevisible.The
displayusesatalleraspectratiothanotherheadsets,providingmoreverticalareaforusersto
lookaroundwithoutneckmovements.Thecurrentversionrequiresconnectingabundleof
cablestofunction,includingaHDMI,USB,andpowercable,anditincludesa3.5mmjackfor
headphones.Theheadsetcontains37sensors,includingagyrosensor,accelerometer,andlaser
positiontrackers.
Unity
ThesimulationprototypeisbuiltonUnity2,“across-platformgameenginewithabuilt-
inIDE(integrateddevelopmentenvironment)developedbyUnityTechnologies.Itisusedto
developvideogamesforwebplugins,desktopplatforms,consolesandmobiledevices.”
Additionally,theHTCViveandUnityareextremelycompatibleforvirtualrealitydevelopment,
withtheassistanceofafewlibraries.TheSteamVRSDK3,anofficiallibrarydevelopedbyValve,
providesasetoftoolsforsimplifyingUnitydevelopmentwithallmajorvirtualrealityheadsets.
AnotherusefullibraryisVRTK4,atoolkitforbuildingVRsolutionsinUnity.Itprovidesa
collectionofusefulscriptsandconceptstocoveranumberofcommonsolutionssuchas
movement,interactionusingtouchingorgrabbing,andcontrolsmapping.
2“Unity–GameEngine,”https://unity3d.com 3“SteamVR,”https://developer.valvesoftware.com/wiki/SteamVR4“VRTK“Unity–GameEngine,”https://unity3d.com–VirtualRealityToolkit,”https://vrtoolkit.readme.io
7
DevelopmentProcess
Atthestartofthedevelopmentprocess,Ihadbeensituatedinmyownlabspace,
separatedfromateamofgraduatestudentsinthedepartmentofcomputersciencethat
workedondevelopingthecoresimulationfeatures.Giventhis,Idecidedcreatinganoptional
virtualrealitymodulewithoutalteringthecodebaseofthecoresimulationitselfwouldbethe
bestapproach.Thiswouldnotonlyresultinapotentiallyreusablemoduleforaccomplishing
similarsolutionsforfutureprojectsbythePI,butpreventconflictingworkbetweenmyselfand
thepartneringteam.
BuildingtheModule
Idesignedastructurewhereobjectsinthecoresimulationwouldbeselectively
transformed,configured,ordestroyedforavirtualrealityenvironment.Ascriptcalled
VRManagerperformstransformationstoobjectsinthemainsimulationforcompatibilitywith
thevirtualrealityfeatures,whereasascriptcalledVRControlshandlesreconfiguringkeyboard
andmousecontrolsforinputusingthehandheldcontrollers.
InUnity,scenescontaintheobjectsofthevirtualworld.Theobjectshandlingtheseprocedures
werepackagedintoascene,whichIdesignedtobeloadedwiththescenecontainingthemain
scenarioobjects.Unityprovidestheabilitytoloadmultiplescenesatonce,allowingthistobe
possible.Beforemakinganydesiredchangestothemainsimulation,wehadaworking,
independentvirtualrealitymoduletoperformtheneededchanges.However,tocreatethe
bestexperience,changesweredonetothevirtualworldofthemainsimulationtobetter
accommodatethenewmeansofinteraction.
8
Figure3.Diagramoftransformationstopoliceuse-of-forcesimulationbythevirtualrealitymodule
Figure4.Filestructurediagramofvirtualrealitymodule
ModificationstoSimulation
Eventually,thePIrelocatedmeintothemainlabandintegratedmewiththepartnering
teamofgraduatestudents.DrivenbyfeedbackandrequestsbythePI,myteamintroduced
9
variousminorchangestothemainsimulationtobetteraccommodatetransformationsapplied
bythevirtualrealitymodule,whilstretainingitsindependencefromthevirtualrealityfeatures.
Initially,thescenariospacewasmuchlargerthantheroomareaandrequiredameansof
repositioningtheplayareaaroundthegameworld,otherwiseuserswouldnothaveenough
real-worldspacetonavigatethevirtualenvironment.Iimplementedameansof“teleporting”
aroundtheenvironment,whichwaseventuallydiscardedinfavorofreducingtheareaofthe
scenarioworld.ThePIdeterminedtheteleportationfeaturewouldnegativelyaffectimmersion.
Initscurrentiteration,userscanfullynavigatethevirtualenvironmentbyonlymovingaround
therealworld.Anotherchangetothescenarioincludedrescalingtheworldtomatchthe
perceptionofthevirtualrealityusersothatobjectsdidnotappeartoosmallorlarge.Scripts
forthesimulationcontrolswereuncoupledtoalloweasierreconfiguration.Toimprove
immersion,improvedplayerhandmodels,additionalfloraanddistantlandscapessurrounding
thescenarioarea,ambientsounds,andwindeffects,wereaddedtothevirtualenvironment.
Figure5.Anoverviewofthevirtualenvironmentforthescenario.
Atransitionscenewasaddedtohandleproperpositioningoftheuserintherealworld
beforethestartingthescenario.Inthevirtualenvironment,thetransitionsceneinstructsthe
10
usertostandinadesignatedarea,reflectingtheidealrealworldstartinglocation.This
preventedawkwardinteractionsresultingfromtheplayerstandingfarfromtheintended
startinglocation.
SimulationWalkthrough
Theiterationofthesimulationweusedtocollectdataincludestutorial,transition,and
scenariostages.Inthevirtualrealitysimulation,thetransitionstagerequiresuserstoposition
themselvesbeforethetutorialandeachattemptatthescenario.Inthemouseandkeyboard
simulation,userscansimplycontinuebypressingabuttononthekeyboard.
Figure6.Dialogueguidesusershowtointeractwithvirtualcharactersandusethegun.
Thetutorialwalksusersthroughthecontrolsusingguideddialogues,describinghowto
movearound,interactwithvirtualcharacters,anddraw,fire,orholsteragun.Thetutorial
displaysdialoguespecifictothetypeofinputused.Afterthetutorial,anexplanationofthe
scenarioispresented:
Twominutesago,dispatchreceivedthiscallfromadistressedwoman:“My
sonhasbeenlivingwithmefortwomonths,andtodayItriedtokickhimout
ofmyhouse.Buthewon’tleave!Hegotangry,andIgotscared,soIlocked
myselfinthehouse,buthe’sstilloutsidepoundingonthedoor.Ithinkhehas
11
aknife.Pleasehelpme.”Youaretheclosestpoliceofficertothataddressand
areonyourwaytorespond.
Usersbeginthescenariowhenready.Userstaketheroleofapoliceofficerandhavethe
optiontotalktoasuspect,aswellasdrawtheirgunandfire.Ifthepoliceofficergetstooclose
orpointsthegunatthesuspect,hewillbeginadvancingtowardstheofficerandattackwitha
knifeifinrange.Iftheofficerretreatstocover,thesuspectsurrenders.
Figure7.Thepoliceofficerinteractswiththesuspect,andthesuspectattacksusingaknife.
Attheendofeveryattempt,ascoreona0to4scaleisdisplayed.Thefollowingscores
areawardedbasedonspecificcriteria:
• Score0ifofficerdied.
• Score1ifsuspectdiedanddidnotthreatentheofficer.
• Score2ifthesuspectdiedanddidthreatentheofficer.
• Score3ifsuspectsurrenderedandthreatenedtheofficer.
• Score4ifsuspectsurrenderedanddidnotthreatentheofficer.
Thesimulationkeepstrackofthenumberofattemptsandsendsuserstothetransitionstage
wheretheycanreattemptthescenariowhenready.
12
Evaluation
ExperimentalDesign
Myteamperformedaresearchstudytogatherdataforawithinsubjectsexperimentto
testtheeffectivenessofthevirtualpolicetrainingsimulation.Participationinvolvedusers
playingthetwoversionsofthesimulation:thedesktopversionusingkeyboardandmouse
inputandtheversionusingvirtualrealityequipment.Thesessionswereexpectedtolastabout
halfanhour,withuserscappedattenplaysessionsperversion.Thestudyrequiredparticipants
tobeatleast18yearsofageandwillbeabletochoosetowithdrawatanytimeduringthe
study.Wecollectedthreekindsofdata:
• Theactionstheparticipanttakeswhileplayingthesimulation.
• Physiologicaldata,includingheartrate,skintemperature,andskinconductance.
• Answerstosurveyquestionsaftersessions.
Thesemeasureshavebeenproposedaseffectivemethodsofgaugingeffectivenessofvirtual
realityenvironments[11].Thecollecteddataremainedcompletelyanonymous,andtherewere
nomeansofconnectingnamesofparticipantswiththedata.Theresultsoftheresearchmaybe
publishedwithoutuseoftheidentitiesofparticipants.
PresenceSurveys
Builtontheunderlyingfactorsofpresence,apresencequestionnairemeasuresthe
senseofpresenceinusersinvirtualrealityenvironments.Experimentationusingthis
questionnairesupportsreliableandconsistentresultsthatallowtheevaluationofexperienced
presenceinusers[3].Thequestionsaskedbythepresencequestionnairecanbeviewedin
13
appendixI.Tocollectdataforthewithinsubjectsexperiment,wecreatedasurveyusingthe
originalLikertScale5(1to7)questionsfromthepresencequestionnaire.
Figure8.Aquestionfromthesurveytocomparethetypesofcontrols.
InsteadofusingtheLikertScale,weaskeduserstocomparethetwotypesofcontrols.Foreach
question,participantsselectediftheyfavoredthevirtualrealitycontrols,mouseandkeyboard
controls,orneither.Thequestionswereframedeitherpositivelyornegatively.Examplesof
positivequestionsare:
• “Inwhichversiondidthemechanismwhichcontrolledthemovementthroughthe
environmentseemmorenatural?”
• “Whichenvironmentseemedmoreconsistentwithyourreal-worldexperiences?”
• “Inwhichversionwereallyoursensesmoreengaged?”
Examplesofnegativequestionsare:
• “Inwhichversionwastheinformationcomingfromyoursensesmoreinconsistentor
disconnected?”
• “Inwhichversionwereyoumoreawareofeventsoccurringintherealworldaround
you?”
5“LikertScale|SimplyPsychology,”https://www.simplypsychology.org/likert-scale.html
14
EmpaticaE4
TheE4wristbandfromEmpaticamonitorsphysiologicalsignalsinreal-time.The
wristbandcollectsdatatobestoredininternalmemoryandretrievedviaUSBthroughprovided
software.Thedevicemeasuresheartrate,skintemperature,andskinconductance.Eachof
thesephysiologicalmeasuresdeterminethefollowing[11]:
• Increasedstress,intensityofemotions,anddefensiveresponses,i.e.fight-or-flight,
increaseheartrate.
• Increasedstressresultsinsweatonthepalms,whichincreasesskinconductance.
• Increasedstressdecreasesskintemperatureasheatmovestothebody’score.
Risks
Thisstudyinvolvedminimalriskstoparticipants.Dependingonchoices,usersmayhave
experiencedviolentcontentinthesimulation,suchasattackingorbeingattacked.Whenusing
thevirtualrealityequipment,usersmayhaveexperiencedmotionsickness.Participantswere
abletowithdrawatanytimeiffeelingdisturbedoruncomfortable.Participantsmayhave
trippedorwalkedintowallsorfurniturewhenusingthevirtualrealityequipment,andwere
discouragedtorunorjump.Aninvestigatorassistedtopreventtheseproblemsfromoccurring.
TestingProcess
Ideally,thePIwaspresentduringastudy.However,asingleteammemberwasableto
carryouttherequiredsteps.Werequiredtheparticipanttoreadandsignaninformedconsent
form,whichwillbekeptbytheinvestigators,andtheparticipantreceivedanunsignedpersonal
copyoftheform.Wepresentedtheparticipantwithavideoaboutthestudyandassociated
risks.Thescriptforthisvideocanbeviewedinappendix3.Beforethefirstplaysession,
15
investigatorsensuredtheparticipantwaswearingheadphonesandtheactivatedsensor
wristband.Inordertoincreaserandomnessinthedata,thePIdecidedtohaveparticipantsplay
themouse-keyboardandvirtualrealitysimulationsindifferingorders.Whenmonitoring
participantsduringthevirtualrealitysimulation,investigatorspreventedthemfromtrippingon
cablesorcollidingwithrealworldobjects.Afterthetutorialstage,aninvestigatorperformeda
verbalquiztomakesuresubjectsunderstandhowtointeractwiththesimulation.Inthesecond
session,theparticipantplayedtheotherversion.Afterwards,theparticipanttookasurvey
containingquestionsthatwillcomparetheexperiences.Checklistsforthetestingprocesssteps
andtheverbalquizzesforbothsimulationscanbeviewedinappendices4and5.Intotal,22
peopleparticipatedinourstudy.
Hypotheses
SurveyData
Ournullhypothesisstateswecanclearlymeasurethattherearenodifferencesin
experiencedpresencebetweenusingvirtualrealitycontrolsandnon-virtualrealitycontrols.
Thealternativehypothesisstatesthatpeopleexperiencehigherpresencewhen
interactingwiththesimulationusingvirtualrealitycontrols.Inthefinalsurvey,eachquestion
servedasindividualhypothesestosupportourgeneralalternativehypothesis.Weexpected
thatuserswillselectthevirtualrealitysimulationasresponsestopositivequestions,andthe
mouseandkeyboardsimulationtothenegativequestions.Weconsideredresultssignificant
when𝑝 < 0.05.
16
PhysiologicalData
Thenullhypothesisstateswecanclearlymeasurethatpeopledonotexperienceany
differencesinheartrate,skintemperature,orskinconductancebetweenusingvirtualreality
controlsandnon-virtualrealitycontrols.
Thealternativehypothesisstatesthatpeopleexperiencehigherheartrateandskin
conductanceandlowerskintemperaturewhenusingthevirtualrealitycontrols.Weconsidered
resultssignificantwhen𝑝 < 0.05.
Results
Usingthecollecteddatafromthepositivequestions(responseswithvirtualreality
controlsareconsideredsuccessful)andthebinomialexacttest6,wederivedthefollowing
results:
Question P-value SuccessorFailure
Inwhichversiondidyourinteractionswiththeenvironmentseemmorenatural?
<0.0001 Success
Inwhichversiondidthemechanismwhichcontrolledthemovementthroughtheenvironmentseemmorenatural?
<0.0001 Success
Whichenvironmentseemedmoreconsistentwithyourreal-worldexperiences?
0.0004 Success
Inwhichversiondidyouadjusttotheenvironmentmorequickly? 0.4159 FailureInwhichversionwereallyoursensesmoreengaged? <0.0001 SuccessInwhichversiondidyoufeelmoreinvolved? <0.0001 SuccessInwhichversionwereyoubetterabletolearnnewtechniquesthatenabledyoutoimproveyourperformance?
0.5841 Failure
Inwhichversionwereyoumorelikelytohavelosttrackoftime? <0.0001 SuccessInwhichenvironmentwasiteasiertosurveyorsearchtheenvironmentusingvision?
0.0022 Success
Whichenvironment'svisualaspectsinvolvedyoumore? <0.0001 SuccessInwhichversionwereyoubetterabletoexamineobjects? <0.0001 Success
6“Signandbinomialtest–GraphPad,”https://graphpad.com/quickcalcs/binomial1.cfm
17
Inwhichversionwasiteasiertoexaminetheobjectsfrommultipleviewpoints?
0.0262 Success
Inwhichversionwasyoursenseofobjectsmovingthroughspacemorecompelling?
<0.0001 Success
Inwhichenvironmentwasyoursenseofmovingaroundmorecompelling? <0.0001 SuccessWhichenvironmentallowedyoutocontroleventsmore? 0.4159 FailureWhichenvironmentwasmoreresponsivetoactionsthatyouinitiated? 0.4159 FailureInwhichenvironmentwasiteasiertoanticipatewhatwouldhappennextinresponsetotheactionsthatyouperformed?
0.4159 Failure
Inwhichenvironmentdidyouexperiencelessdelaybetweenyouractionsandexpectedoutcomes?
0.2617 Failure
Attheendofwhichversiondidyoufeelmoreproficientinmovingandinteractingwiththeenvironment?
0.0669 Failure
Inwhichversiondidtheauditoryaspectsoftheenvironmentinvolveyoumore?
0.0669 Failure
Inwhichversionwereyoubetterabletoidentifysounds? 0.2617 FailureInwhichversionwereyoubetterabletolocalizesounds? 0.2617 FailureInwhichversionwasiteasiertoconcentrateontheassignedtaskorrequiredactivityratherthanthemechanismusedtoperformthattaskoractivity?
0.1431 Failure
Figure9.Resultsfrompositivequestions.
Usingthecollecteddatafromthenegativequestions(responseswithmouseand
keyboardcontrolsareconsideredsuccessful)andthebinomialexacttest,wederivethe
followingresults:
Question P-value SuccessorFailure
Whichversion'svisualdisplayqualitydistractedyoumorefromperformingassignedtasksorrequiredactivities?
0.9978 Failure
Whichversion'scontroldevicesinterferedwiththeperformanceofassignedtasksorwithotheractivitiesmore?
0.9978 Failure
Inwhichversionwastheinformationcomingfromyoursensesmoreinconsistentordisconnected?
0.7383 Failure
Inwhichversionwereyoumoreawareofeventsoccurringintherealworldaroundyou?
0.7383 Failure
Figure10.Resultsfromnegativequestions.
UsingthecollecteddatafromtheEmpaticaE4wristband,wedeterminedthefollowing
physiologicalmeasuresofeachparticipantforeachtypeofcontrols:
18
ScreenandKeyboardControls VirtualRealityControls Avg.Heart
RateAvg.SkinConductance
Avg.SkinTemperature
Avg.HeartRate
Avg.SkinConductance
Avg.SkinTemperature
1 92.36077 1.274387948 29.68203 89.21679 2.272121741 29.32172 76.68999 2.26369234 30.57542 97.34781 0.007058844 30.084383 69.54255 0.173946012 29.55234 93.28822 0.14598 29.863564 101.843 0.505350189 31.20191 77.61375 1.026217515 30.65655 66.59121 11.54714801 32.08922 76.29338 12.26386446 31.469216 71.96516 3.101729086 32.72039 87.13103 5.263905096 31.815967 66.74796 4.285835635 32.67378 77.847 7.380404994 32.218288 92.206 1.514237731 30.68759 92.50182 1.872756067 30.034739 54.05715 2.03460883 30.50059 87.67895 1.758665643 29.8052610 89.58912 0.20347604 32.7041 83.19086 0.378058451 31.9664811 85.84356 0.217890239 33.0517 95.15121 0.178347525 31.8699612 90.21457 3.998313096 31.72339 90.32761 2.304212966 31.3272713 84.39114 0.129377925 32.50263 88.4671 0.298714755 31.7297914 78.33746 0.554526781 30.71204 85.19854 0.694904573 31.0699215 85.44402 10.53729823 30.36633 77.78777 13.53612226 30.4247716 97.82346 0.642728136 32.68742 87.23371 0.240282793 32.0588917 104.13 0.704708484 33.0955 96.65304 0.529796355 33.6034618 66.8685 0.174966849 27.83869 86.71173 0.213470654 28.0513419 71.16255 0.28133171 31.674 100.1707 0.240097054 31.2841220 72.39835 2.216489594 32.15044 76.23893 2.654827589 30.9476621 76.03564 2.962413193 32.8247 90.08419 3.063555467 32.6300722 89.01866 1.299854505 31.05527 93.73348 1.961813843 31.71859Figure11.PhysiologicaldatafromtheEmpaticaE4wristbandforeachparticipant.
Usingthephysiologicaldatafromthe22participants,wecountedthenumberof
participantswhorespondedmorestronglywhenusingthevirtualrealitycontrolstodetermine
thefollowingresults:
PhysiologicalMeasure ScreenandKeyboard
VirtualReality(SupportsHypothesis)
P-value SuccessorFailure
HigherAvg.HeartRate 6 16 0.0262 SuccessHigherAvg.SkinConductance 8 14 0.1431 FailureLowerAvg.Skintemperature 6 16 0.0262 SuccessFigure12.Resultsfromnumbersofparticipantswithsupportingphysiologicaldata.
19
Discussion
Thebinomialexacttestanddatacollectedfromsurveyssupportthefollowing
improvementstopresencebyvirtualrealitytechnology:
• Interactingwiththeenvironmentseemedmorenatural.
• Controllingtheenvironmentwiththeinputdeviceseemedmorenatural.
• Theenvironmentseemedmoreconsistentwithreal-worldexperiences.
• Sensesandinvolvementintheenvironmentwereheightened.
• Visuallyexploringtheenvironmentseemedeasierandmorecompelling.
• Navigatingtheenvironmentseemedmorecompelling.
• Usersexperiencedmoreunexpectedstimuli.
Theseimprovementstothevisualimmersionandnavigationofthevirtualenvironmentsupport
ourgeneralalternativehypothesisstatingthatpeopleexperiencehigherpresencewhen
interactingwiththesimulationusingvirtualrealityequipment.
Accordingtoourcollectedphysiologicaldata,Usersexperiencedincreasedheartrateand
decreasedskintemperaturewhenusingvirtualrealitycontrols.Thesephysiologicalmeasures
supportthefollowing:
• Usersexperiencedincreasedstress.
• Usersfeltmoreintenseemotions.
• Usersreactedtostimulimorefrequentlywithdefensiveresponses,i.e.fight-or-flight
response.
However,thecollecteddatacannotsupportthefollowingimprovementstopresence:
20
• Adjustingtotheenvironmentandnavigatingwithinitseemedeasier.
• Concentratingonandlearningnewtechniquesseemedeasier.
• Theenvironmentseemedmoreresponsiveandanticipatable.
• Auditoryaspectsseemedmoreidentifiableandcompelling.
Therearemanypotentialreasonswhyourcollecteddatadoesnotsupportthese
improvements.Themostlikelyoftheseare:
• Currentvirtualrealityhardwarelimitedimmersion.Someusershaddifficultyadjusting
tounfamiliarcontrols,whilemostwerefamiliarwiththescreen,mouse,andkeyboard.
Aspeoplebecomemorefamiliarwithvirtualrealityinteractions,futureiterationsof
virtualrealityhardwarewillbringimprovementsinthisarea.
• Userslackedtimetoprepareforthescenario.Infutureversions,wecouldexpandon
thetutorialtobetterprepareusersforinteractionwiththevirtualenvironment.
• Userswereunfamiliarorfascinatedwiththevirtualrealityhardware.Thiscould
attributetodifficultyadjustingtonewcontrolsandfocusingontheassignedtask.
Conclusion
UsingtheHTCViveandcompatiblesoftware,weintegratedvirtualrealitytechnology
withanimmersiveinteractivetrainingsimulation.Myteamconductedaresearchstudyto
comparethechangeswiththescreenandkeyboardversionofthesimulation.Accordingtothe
collecteddatafrompresencequestionnaires,virtualrealitytechnologybroughtimprovements
topresencebymakingtheenvironmentseemmorecompelling,naturaltointeractwith,and
visuallyimmersive.Thisimprovesthesimulation’sabilitytoelicitrealisticbehaviorinusers.As
21
virtualrealityhardwarecontinuestoimproveandusersbecomemorefamiliarwithinteracting
withenvironmentsusingvirtualrealitysystems,thepotentialforthistechnologytobring
improvementstovirtualenvironmentswillonlyincrease.
22
Bibliography
[1] R.T.HaysandM.J.Singer,SimulationFidelityinTrainingSystemDesign:BridgingtheGap
BetweenRealityandTraining,NewYorkCity:SpringerScience&BusinessMedia,2012.
[2] C.ConstantinandD.Grigorovici,"VirtualenvironmentsandthesenseofBeingThere:an
SEMmodelofpresence,"Proceedingsofthe6thAnnualInternationalWorkshopon
Presence,2003.
[3] B.G.WitmerandM.J.Singer,"Measuringpresenceinvirtualenvironments:apresence
questionnaire,"Presence:TeleoperatorsandVirtualEnvironments,vol.7,no.3,pp.225-
240,1998.
[4] J.v.BarenandW.A.IJsselsteijn,"Measuringpresence:aguidetocurrentmeasurement
approaches,"OmnipresProject,2008.
[5] C.Dede,"Theevolutionofconstructivistlearningenvironments:Immersionindistributed,
virtualworlds,"EducationalTechnology,vol.35,no.5,pp.46-52,1995.
[6] D.B.Maxwell,"GaugingTrainingEffectivenessofVirtualEnvironmentSimuationBased
ApplicationsforanInfantrySoldierTrainingTask,"UniversityofCentralFlorida,Orlando,
2015.
[7] N.Wardrip-Fruin,M.Mateas,S.DowandS.Sali,"Agencyreconsidered,"Proceedingsof
theDigitalGamesResearchAssociation,2009.
23
[8] M.Slater,"Placeillusionandplausibilitycanleadtorealisticbehaviourinimmersive
virtualenvironments,"PhilosophicalTransactionsoftheRoyalSocietyofLondonB:
BiologicalSciences,vol.364,no.1535,pp.3549-3557,12Dec2009.
[9] R.M.Young,S.G.Ware,B.A.CassellandJ.Robertson,"Plansandplanninginnarrative
generation:areviewofplan-basedapproachestothegenerationofstory,discourseand
interactivityinnarratives,"SpracheundDatenverarbeitung,SpecialIssueonFormaland
ComputationalModelsofNarrative,vol.37,no.1-2,pp.41-42,2013.
[10]R.T.Azuma,"ASurveyofAugmentedreality,"Presence:TeleoperatorsandVirtual
Environments,pp.202-205,1997.
[11]B.E.Insko,"Measuringpresence:subjective,behavioralandphsyiologicalmethods,"
BeingThere:concepts,effectsandmeasurementofuserpresenceinsynthetic
environments,vol.5,pp.109-120,2003.
24
Appendix1:PresenceQuestionnaire
• Doyouevergetextremelyinvolvedinprojectsthatareassignedtoyoubyyourbossoryourinstructor,totheexclusionofothertasks?
• Howeasilycanyouswitchyourattentionfromthetaskinwhichyouarecurrentlyinvolvedinanewtask?
• Howfrequentlydoyougetemotionallyinvolved(angry,sad,orhappy)inthenewsstoriesthatyoureadorhear?
• DoyoueasilybecomedeeplyinvolvedinmoviesorTVdramas?• Doyoueverbecomesoinvolvedinatelevisionprogramorbookthatpeoplehaveproblems
gettingyourattention?• Howmentallyalertdoyoufeelnow?• Doyoueverbecomesoinvolvedinamoviethatyouarenotawareofthingshappening
aroundyou?• Howfrequentlydoyoufindyourselfcloselyidentifyingwiththecharactersinastoryline?• Doyoueverbecomesoinvolvedinavideogamethatitisasifyouareinsidethegame
ratherthanmovingajoystickandwatchingthescreen?• Onaverage,howmanybooksdoyoureadforenjoymentinamonth?• Howphysicallyfitdoyoufeeltoday?• Howgoodareyouatblockingoutexternaldistractionswhenyouareinvolvedinsomething?• Whenwatchingsports,doyoueverbecomesoinvolvedinthegamethatyoureactasifyou
wereoneoftheplayers?• Doyoueverbecomesoinvolvedinadaydreamthatyouarenotawareofthingshappening
aroundyou?• Doyoueverhavedreamsthataresorealthatyoufeeldisorientedwhenyouawake?• Whenplayingsports,doyoubecomesoinvolvedinthegamethatyoulosetrackoftime?• Howwelldoyouconcentrateonenjoyableactivities?• Howoftendoyouplayarcadeorvideogames?(OFTENshouldbetakentomeaneveryday
oreverytwodays,onaverage.)• Howwelldoyouconcentrateondisagreeabletasks?• HaveyouevergottenexcitedduringachaseorfightsceneonTVorinthemovies?• HaveyouevergottenscaredbysomethinghappeningonaTVshoworinamovie?• Haveyoueverremainedapprehensiveorfearfullongafterwatchingascarymovie?• HowfrequentlydoyouwatchTVsoapoperasordocu-dramas?• Doyoueverbecomesoinvolvedindoingsomethingthatyoulosealltrackoftime?
25
Appendix2:IntroductionVideoScript
ThankyouforparticipatingintheUniversityofNewOrleans,ComputerScience,PoliceUseofForceSimulation.Duringyoursessionwithus,you’llbeinteractingwithaprototypeofapolicetrainingsimulationviabothMonitor,Keyboard,andmouseandvirtualrealityheadsetwithcontrollers.Theexpecteddurationofyoursessionwillbeapproximately30minutes.Pleasenote,dependingonthechoicesmade,youmayexperienceviolentacts.Tostartoff,youwilltakeabriefquestionnaire.Datareceivedinthisstudywillberecordedanonymouslyusingyourparticipantnumber.Aresearcherwillbewithyoualwaysincaseyouneedanyassistance.Youwillthenbedirectedtoyourfirstroundofsimulations.YouwillfirstplaythroughaTutorial,whereyouwillfamiliarizeyourselfwiththecontrols.Oncecompleted,anintroductiontothescenariowillappear,andthenthesimulationwillcommence.Whenthesimulationiscomplete,youwillreceiveascore.Youwillrepeatthesimulationatleastonce,butfeelfreetoplayasmanytimesasyoulike.Whenyouarereadytoleave,pleasetellyouraccompanyingresearcher.Youwillthenbeaskedtocompleteasecondquestionnaire.Oncecompleted,youwillthenbedirectedtoplaythesimulationagain,thistimeusingadifferentsetofcontrols.Justlikethepreviousround,youwillplaythroughthesimulationatleast2times,andcanplayasmanytimesasyoulike.Attheendofthesimulation,youwillthenbeaskedtofilloutthethirdandfinalquestionnaire.Oncecompleted,youwillbedonewiththestudy.Beforegettingstarted,hereareafewthingsyoushouldknow.Inthisstudy,weareusingtheHTCViveVirtualRealityHeadset,Camera,andControllers.Yourmovementsandactionsintherealworldwillbetrackedinthesimulation.However,withtheheadseton,yourperceptionoftheenvironmentaroundyouwillbeimpaired.Theheadsetiswiredtoacomputerwhichmaybeapotentialtrippinghazard.Aresearcherwillbewithyoualways,monitoringyouandthecableasyoumovearound.Becauseofthis,weaskthatyoumoveslowlyanddeliberatelywhenyouhavethevirtualrealityheadseton.Asyouapproachawallintheroom,abluegridrepresentingthewallwillalsoappearinthesimulation.Pleasedonotattempttomovebeyondthisgrid.Whenusingthevirtualrealitycontrols,youwillhavealeftandrightcontroller.Thesimulationuses:
26
• thetrackpadontopofthecontroller• thetriggeronthebottomofthecontroller• andeitherofthegripbuttonsonthesideofthecontroller.
WhenusingtheMonitor,Keyboard,andMouse,thekeysWASDorUp/Down/Left/RightArrowandSpacebarwillbeusedonthekeyboard.MouseMovementandLeftandRightMouseButtonswillalsobeused.Thankyouverymuch!Weappreciateyourparticipationinourstudy!
27
Appendix3:ScreenandKeyboardChecklistandVerbalQuiz
GeneralGuidelines
• Youaretheinvestigator.Thepersonplayingistheparticipant.• Youcananswerquestionsaboutthepurposeofthisstudy,butonlyafteritisoverandnotinthe
presenceofwaitingparticipants.• Youcannotmakesuggestionsaboutwhatactionstheparticipantshouldtake,eveniftheyask
forhelporhints.Ifasked,youcansay“Ican’tanswerthatquestionuntilafterthestudyifover.”
• Youcananswerquestionsaboutthecontrols.• Youcantelltheparticipantthatthegoalistoget4outof4andthatitispossibletoachievethis
score.Step-by-StepChecklist
� Ideally,Dr.Wareispresent.Atleastoneofthefollowingpeoplemustbepresent:ETGarcia,DharmeshDesai,orTedMader.
� TheparticipantMUSTreadandsignaninformedconsentform.� Keepthesignedconsentform.� Givetheparticipantasecondcopyoftheconsentformtotakehome.Itdoesnotneedtobe
signed.� AssignauniqueIDnumbertotheparticipantandwritesitatthetopofthispage.� AsktheparticipanttositatComputer1andputontheheadphones.� Showtheparticipanttheintroductionvideo.� Whilethevideoisplaying,setupthefirstsurveyonComputer2andentertheparticipant’s
numberonthefirstscreen.� Afterthevideoisfinished,straptheEmpaticawatchtotheirarm.Pressandholdthebuttonfor
twosecondsuntilthelightturnsgreen.� AsktheparticipanttotakethefirstsurveyonComputer2.� Whiletheparticipantistakingthefirstsurvey,setupthescreenandkeyboardsimulationon
Computer1.� Aftertheparticipantfinishesthefirstsurvey,bringtheparticipantbacktoComputer1.� Makesuretheimagedisplayingthecontrolsisvisibleonthesecondscreen.� Puttheheadphonesontheparticipant.� Theparticipantplaysthescreenandkeyboardversionofthesimulation.� Whentheparticipantisfinishedwiththetutorial,givethemtheverbalquizaboutthecontrols.� Whentheparticipantisfinishedplaying,setupthesecondsurveyonComputer2andenterthe
participantnumberonthefirstpage.� TheparticipanttakesthesecondsurveyonComputer2.� Whiletheparticipantistakingthesecondsurvey,setupthevirtualrealityversionofthe
simulationonComputer1andconfirmthatsoundiscomingthroughtheheadphones.� Aftertheparticipantfinishesthesecondsurvey,bringtheparticipantbacktoComputer1.� ShowtheparticipanttheVivehandcontrollersbutdonothandthemtotheparticipantyet.
28
� Lettheparticipantknowyouwilltaptheirshouldertotalktothem.� HelptheparticipantputontheViveheadset.� HandtheparticipanttheVivehandcontrollersoneatatime.Makesuretheirwristsarethrough
thewriststrapsdotheydon’tdropthecontrollers.� Puttheheadphonesontheparticipant.� Watchtheparticipantthewholetimetheyareplaying.Focusonthecableandtheparticipant,
notthescreen,wheneverpossible.� Whentheparticipanthasfinishedthetutorial,givethemtheverbalquizaboutthecontrols.� Whiletheparticipantisplaying,setupthethirdsurveyonComputer2andentersthe
participantnumberonthefirstpage.� TheparticipanttakesthethirdsurveyonComputer2.� PressandholdthebuttonontheEmpaticawatchfor2secondsuntilthelightturnsoff.Remove
thewatchfromtheparticipant.� MakesureyouhavethesignedconsentformandgiveittoDr.Ware.� MakesureyouremovedtheEmpaticawatchfromtheparticipant.� MakesurebothgamelogsandtheEmpaticadataarecommittedtoSVN.� Attheendoftheday,cleanallequipment.� Attheendoftheday,makesuretheVivehandcontrollersandtheEmpaticawatchareplugged
inandcharging.VerbalQuiz
Askthesequestionsafterthetutorial,butbeforetheactualsimulationstarts.Theparticipantmustshowyoutheanswerratherthanjustsayit.Forexample,theparticipantshouldpressthegripbuttonratherthanjustsay“gripbutton.”Iftheparticipantgetsaquestionwrong,showandtellthemtheanswer.Attheendofthequiz,iftheparticipantgotanyquestionswrong,repeatituntiltheygetallquestionsright.Q:Howdoyouwalkaround? A:WiththeW,A,S,andDkeysorthearrowkeys.Q:Howdoyoudrawthegun?
A:Leftmousebutton.Q:Howdoyouraisethegun? A:Leftmousebutton.Q:Howdoyoufirethegun? A:Leftmousebutton.Q:Howdoyoulowerthegun? A:Rightmousebutton.Q:Howdoyouputthegunaway? A:Rightmousebutton.Q:Howdoyoutalktoothercharacters? A:Spacebar.Q:Howdoyouswitchbetweendialogoptionswhentalking? A:Arrowkeys.
29
Appendix4:VirtualRealityChecklistandVerbalQuiz
GeneralGuidelines
• Youaretheinvestigator.Thepersonplayingistheparticipant.• Youcananswerquestionsaboutthepurposeofthisstudy,butonlyafteritisoverandnotinthe
presenceofwaitingparticipants.• Youcannotmakesuggestionsaboutwhatactionstheparticipantshouldtake,eveniftheyask
forhelporhints.Ifasked,youcansay“Ican’tanswerthatquestionuntilafterthestudyifover.”
• Youcananswerquestionsaboutthecontrols.• Youcantelltheparticipantthatthegoalistoget4outof4andthatitispossibletoachievethis
score.Step-by-StepChecklist
� Ideally,Dr.Wareispresent.Atleastoneofthefollowingpeoplemustbepresent:ETGarcia,DharmeshDesai,orTedMader.
� TheparticipantMUSTreadandsignaninformedconsentform.� Keepthesignedconsentform.� Givetheparticipantasecondcopyoftheconsentformtotakehome.Itdoesnotneedtobe
signed.� AssignauniqueIDnumbertotheparticipantandwritesitatthetopofthispage.� AsktheparticipanttositatComputer1andputontheheadphones.� Showtheparticipanttheintroductionvideo.� Whilethevideoisplaying,setupthefirstsurveyonComputer2andentertheparticipant’s
numberonthefirstscreen.� Afterthevideoisfinished,straptheEmpaticawatchtotheirarm.Pressandholdthebuttonfor
twosecondsuntilthelightturnsgreen.� AsktheparticipanttotakethefirstsurveyonComputer2.� Whiletheparticipantistakingthefirstsurvey,setupthevirtualrealityversionofthesimulation
onComputer1andconfirmthatsoundiscomingthroughtheheadphones.� Aftertheparticipantfinishesthefirstsurvey,bringtheparticipantbacktoComputer1.� ShowtheparticipanttheVivehandcontrollersbutdonothandthemtotheparticipantyet.� Lettheparticipantknowyouwilltaptheirshouldertotalktothem.� HelptheparticipantputontheViveheadset.� HandtheparticipanttheVivehandcontrollersoneatatime.Makesuretheirwristsarethrough
thewriststrapsdotheydon’tdropthecontrollers.� Puttheheadphonesontheparticipant.� Watchtheparticipantthewholetimetheyareplaying.Focusonthecableandtheparticipant,
notthescreen,wheneverpossible.� Whentheparticipanthasfinishedthetutorial,givethemtheverbalquizaboutthecontrols.� Whentheparticipantisfinishedplaying,setupthesecondsurveyonComputer2andenterthe
participantnumberonthefirstpage.
30
� TheparticipanttakesthesecondsurveyonComputer2.� Whiletheparticipantistakingthesecondsurvey,setupthescreenandkeyboardsimulationon
Computer1.� Makesuretheimagedisplayingthecontrolsisvisibleonthesecondscreen.� Aftertheparticipantfinishesthesecondsurvey,bringtheparticipantbacktoComputer1.� Puttheheadphonesontheparticipant.� Theparticipantplaysthescreenandkeyboardversionofthesimulation.� Whentheparticipantisfinishedwiththetutorial,givethemtheverbalquizaboutthecontrols.� Whiletheparticipantisplaying,setupthethirdsurveyonComputer2andentersthe
participantnumberonthefirstpage.� TheparticipanttakesthethirdsurveyonComputer2.� PressandholdthebuttonontheEmpaticawatchfor2secondsuntilthelightturnsoff.Remove
thewatchfromtheparticipant.� MakesureyouhavethesignedconsentformandgiveittoDr.Ware.� MakesureyouremovedtheEmpaticawatchfromtheparticipant.� MakesurebothgamelogsandtheEmpaticadataarecommittedtoSVN.� Attheendoftheday,cleanallequipment.� Attheendoftheday,makesuretheVivehandcontrollersandtheEmpaticawatchareplugged
inandcharging.VerbalQuiz
Askthesequestionsafterthetutorial,butbeforetheactualsimulationstarts.Theparticipantmustshowyoutheanswerratherthanjustsayit.Forexample,theparticipantshouldpressthegripbuttonratherthanjustsay“gripbutton.”Iftheparticipantgetsaquestionwrong,showandtellthemtheanswer.Attheendofthequiz,iftheparticipantgotanyquestionswrong,repeatituntiltheygetallquestionsright.Q:Howdoyouwalkaround? A:Bywalkingaroundtheroom.Q:Howdoyoudrawthegun?
A:Rightgripbuttonwhilehandisatyourside.Q:Howdoyoufirethegun? A:Righttrigger.Q:Howdoyouputthegunaway? A:Righttriggerwhilethegunisatyourside.Q:Howdoyoutalktoothercharacters? A:Pressthetrackpad.Q:Howdoyouswitchbetweendialogoptionswhentalking? A:Tapthetrackpad.