virtual reality and health - unc health sciences library · virtual reality and health jason...
TRANSCRIPT
Jason Jerald, PhD @TheVRBook
Virtual Reality and Health
Jason Jerald, PhD
@TheVRBook
Jason Jerald, PhD @TheVRBook
Jason Jerald, PhD20+ years of VR expertise40+ organizations70+ projects
2
Jason Jerald, PhD @TheVRBook
What is Virtual Reality?
“A computer-generated digital environment
that can be experienced as if that
environment was real.”
—The VR Book
3
Jason Jerald, PhD @TheVRBook
What is Virtual Reality(video)
4
Jason Jerald, PhD @TheVRBook
The XR Continuum
Real
Reality
Virtual
Reality
5
Jason Jerald, PhD @TheVRBook
VR is not New!1830s to 1990s
Images Courtesy of The VR Book (with permissions from original sources)
6
Jason Jerald, PhD @TheVRBook
VR Applications Beyond Entertainment• Real Estate• Medical Visualization• Command & Control• Scientific Visualization• Computer-Aided Design• Education• Simulation & Training• Telepresence• Tourism• Design Review/Markup• Proposals
• Advertising and Marketing• Location Based Exhibits• Retail• Crime Scene Investigation• Psychological studies• Human performance/factors
engineering• Rehabilitation• Pain Distraction• Immersive Film• Sports
7
Jason Jerald, PhD @TheVRBook
Today’s Two VR Applications
• Medical Visualization• Neuroscience Education
8
Jason Jerald, PhD @TheVRBook
Today’s Two VR Applications
• Medical Visualization• Neuroscience Education
9
Jason Jerald, PhD @TheVRBook
Medical Visualization
iMedic by Immersive Medical Environment for Distributed Interactive Consultation
Congressional funding provided by the U.S Army’s Telemedicine & Advanced Technology Research Center
10
Jason Jerald, PhD @TheVRBook
Medical Visualization
iMedic by Immersive Medical Environment for Distributed Interactive Consultation
Congressional funding provided by the U.S Army’s Telemedicine & Advanced Technology Research Center
11
Jason Jerald, PhD @TheVRBook
Medical Teleconsultation
iMedic by
12
Jason Jerald, PhD @TheVRBook
Medical Visualization
iMedic by
(video)
13
Jason Jerald, PhD @TheVRBook
Medical Visualization
iMedic—how does it work?
– 3D Multitouch• Appropriate for abstract non-realistic interactions• Content/data independent• Written Specifically for immersive interaction• Solves gorilla arm• Reduces sim sickness
14
Jason Jerald, PhD @TheVRBook
Today’s Two VR Applications
• Medical Visualization• Neuroscience Education
15
Jason Jerald, PhD @TheVRBook
Education• What does our workforce need in the future?
• The ability to operate across a broader span of tasks and
situations, creating new demands:
–Increased complexity of work
–Continuous competency development
–Different ways of thinking
–Cognitive overloadSource: US General Services Administration
16
Jason Jerald, PhD @TheVRBook
Education
“Tell me and I will forget.Teach me and I will remember.Involve me and I will learn.”
—Benjamin Franklin
17
Jason Jerald, PhD @TheVRBook
Education
Image Courtesy of The VR Book (adapted from Dale [1969])
18
Jason Jerald, PhD @TheVRBook
Neuroscience education by
Education
19
Funding provided by
Jason Jerald, PhD @TheVRBook
Education(video)
20
Jason Jerald, PhD @TheVRBook
Education(video)
21
Jason Jerald, PhD @TheVRBook
Education(video)
22
Jason Jerald, PhD @TheVRBook
EducationVR Immigrants
• Conventional speed• Linear processing• Text first• Step by step• Stand-alone• Passive• Work• Patience• Reality• Technology-as-foe
VR Natives
• Twitch speed• Parallel processing• Graphics first• Random access• Connected• Active• Play• Payoff• Fantasy• Technology-as-friend
23
Jason Jerald, PhD @TheVRBook
Education
“The illiterate of the 21st century will not be
those who cannot read and write, but those
who cannot learn, unlearn, and relearn.”
—Alvin Toffler
24
Jason Jerald, PhD @TheVRBook 25
Jason Jerald, PhD @TheVRBook
Questions
26
Jason Jerald, PhD @TheVRBook
Additional Slides
27
Jason Jerald, PhD @TheVRBook
Adverse Health Effects—Challenges• Injury• Motion sickness• Headset Fit• Hygiene• Aftereffects• Seizures
• Physical Fatigue• Eye strain
– Flicker– Accommodation-vergence
conflict– Occlusion-binocular
Conflict
28
Jason Jerald, PhD @TheVRBook
Factors of Adverse Health EffectsSystem
• Latency• Calibration• Tracking accuracy & precision• Field of View• Refresh rate• Judder & Flicker• Display response & persistence• Vergence/Accommodation• Stereoscopic cues• Real world peripheral vision• Fit/Weight/center of mass• Motion platforms• Hygiene• Temperature• Dirty screens
Application
• Frame rate• Locus of control• Visual acceleration• Physical head motion• Duration• Vection• Binocular-occlusion conflict• Virtual rotation• Gorilla arm• Standing vs sitting• Rest frames• Binocular disparity• VR entrance & exit• Luminance• Repetitive strain
Human
• History of motion sickness• VR experience• Health• Thinking about Sickness• Belief• Gender• Age• Mental model/expectations• Interpupilary distance• Not knowing• Sense of balance• Flicker fusion frequency
threshold• Real-world task experience• Migraine history
29
Jason Jerald, PhD @TheVRBook
Adverse Health Effects
Cables and Safety– Sit in a Chair– Safe audio levels– Use a human spotter– Constrain/limit haptics– Provide harnesses, railing, and/or padding– Spend the time to arrange cables nicely. Cable tie them to
desk, etc. And then leave them.
30
Jason Jerald, PhD @TheVRBook
Adverse Health Effects
Warning Grids
31
Jason Jerald, PhD @TheVRBook
Motion SicknessThe Basics• The biggest problem is motion sickness
– Varies greatly from person to person
• As users:– Stop at the first sign of sickness– Be well-hydrated– Not hungry– Not hung over
• As demoers– Remind users not to “tough it out”– Choose comfortable applications
32
Jason Jerald, PhD @TheVRBook
Motion Sickness
• Sensory Conflict• Evolution/Poison Theory• Postural Instability Theory• Rest Frame Hypothesis• Eye Movement Theory
33
Jason Jerald, PhD @TheVRBook
Locomotion
• Physical walking• Teleportation• Dynamic field of view• Dynamic rest frames
34
Jason Jerald, PhD @TheVRBook
Physical Walking
• Real-world one-to-one walking• Treadmill walking• Redirected walking• Walking in place
35
Jason Jerald, PhD @TheVRBook
Teleportation
• Popularized byCloudHead Games
• Zero motion sickness
• Results in disorientationBowman & Hodges 199
Trainexus by
36
Jason Jerald, PhD @TheVRBook
Dynamic Field of View
Image Courtesy of
Fernandes & Feiner 2016
37
Jason Jerald, PhD @TheVRBook
Rest Frames
• Stabilized cues relative to real world Prothero & Parker (2003)
• Reduces sensory conflict between what you are seeing and what you are feeling
• Example: Cockpit
EVE Valkyrie by CCP Games
38
Jason Jerald, PhD @TheVRBook
Rest Frames
39
Jason Jerald, PhD @TheVRBook
Dynamic Rest Frames
Looking ahead with no DRF Looking ahead with DRF Looking to Right with DRF
by
40
Jason Jerald, PhD @TheVRBook
Head-Mounted Displays
41
Jason Jerald, PhD @TheVRBook
Desks
The Nanomanipulator
42
Jason Jerald, PhD @TheVRBook
DDRIVE by and
CAVEs
43
Jason Jerald, PhD @TheVRBook
CAVEs
44
Jason Jerald, PhD @TheVRBook
Phones & Tablets
Zoo-AR by
45
Jason Jerald, PhD @TheVRBook
VR Input Devices
46
Jason Jerald, PhD @TheVRBook
1_Q&A
47
Jason Jerald, PhD @TheVRBook 48
Jason Jerald, PhD @TheVRBook
1_Q&A
49
Jason Jerald, PhD @TheVRBook
1_Q&A
50
Jason Jerald, PhD @TheVRBook 51
Jason Jerald, PhD @TheVRBook
Try the Merge Things for Yourself!
Go toBit.ly/MThings
52
Jason Jerald, PhD @TheVRBook
Today’s Five VR Applications
• Training• Medical Visualization• Computer-Aided Design• Retail• Education
53
Jason Jerald, PhD @TheVRBook
Computer-Aided Design
• Immersive modeling challenges– Not just polygons & special effects– Large number of options– Precision
54
Jason Jerald, PhD @TheVRBook
by , , &
Computer-Aided Design
55
Jason Jerald, PhD @TheVRBook
by , , &
Computer-Aided Design(video)
56
Jason Jerald, PhD @TheVRBook
Computer-Aided Design
by , , &
57
Jason Jerald, PhD @TheVRBook
Where is Technology Going?The Past
• Expensive• Dedicated hardware• Train key jobs• Formal• Defense dominates• Experts create• Sequential learning• Accidental engagement
The Future
• Inexpensive• Multiuse (e.g., phones)• Train many jobs• Informal• Commercial dominates• Users create• Free-form learning• Intentional Fun
58
Jason Jerald, PhD @TheVRBook
The Future
“The best way to predict the future is to invent it.”
—Alan Kay
59