interactions in virtual reality - extended reality at berkeley · 2018-03-07 · immersive...
TRANSCRIPT
![Page 1: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/1.jpg)
Interactions in Virtual Reality
Copyright 2018 © Virtual Reality at Berkeley
![Page 2: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/2.jpg)
2
Hardware
Gaze Gaze and tap Clickers
Hand tracking 6DOF controllers Eye tracking
![Page 3: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/3.jpg)
Gaze and Hold
Makes the least hardware assumptions. 3
![Page 4: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/4.jpg)
Gaze and Tap
Better, but make targets large and use sparingly. 4
![Page 5: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/5.jpg)
Clickers
More versatile, but potentially a false affordance? 5
![Page 6: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/6.jpg)
Hand Tracking
Most natural, but not necessarily the best. 6
![Page 7: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/7.jpg)
Great compromise between intuitiveness and utility.
Tracked 6DOF controllers
7
![Page 8: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/8.jpg)
Coming soon
Eye tracking
8
![Page 9: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/9.jpg)
9
Presence
![Page 10: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/10.jpg)
Personal: Illusion of Self-embodiment
Environmental: Illusion of Physical Interaction
Social: Illusion of Social Companionship
Presence
10
![Page 11: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/11.jpg)
11
Interactions in Personal Space
![Page 12: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/12.jpg)
Personal Presence
12
![Page 13: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/13.jpg)
IK Arms
![Page 14: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/14.jpg)
IK Arms
![Page 15: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/15.jpg)
15
Environmental Presence
![Page 16: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/16.jpg)
Beware of Metaphors
16
https://i.imgur.com/RjbxvQt.gifv
![Page 17: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/17.jpg)
The more repeated the action, the easier it should be
17
![Page 18: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/18.jpg)
18
Can we do better than reality?
![Page 19: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/19.jpg)
Learnings on Maintaining Environmental Presence
19
● Large arms motions are tiring● If you give the users hands, give them something to do with them● If you let players swing around, they’ll break something (one in N times)
![Page 20: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/20.jpg)
20
Social Presence
![Page 21: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/21.jpg)
Hand-Eye Coordination
Interactive Eye Contact
Eye Tracking
21
![Page 22: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/22.jpg)
Eye Tracking
22
Hand-Eye Coordination
Interactive Eye Contact
![Page 23: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/23.jpg)
Eye Trackers on the Market
23
![Page 24: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/24.jpg)
Full Body Presence
(You can finally kick things!)
Body Tracking
24
![Page 25: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/25.jpg)
Body Tracking
25
Full Body Presence
(You can finally kick things!)
![Page 26: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/26.jpg)
Body Trackers on the Market
26
![Page 27: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/27.jpg)
Tracking
27
Track and show what we can, leave the rest to the brain.
![Page 28: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/28.jpg)
Believable NPCs
A big part of social VR is interacting with other people, but VR is also a powerful tool for interacting with other virtual people.
28
![Page 29: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/29.jpg)
Immersive Journalism
“That was my goal. Take a story about people who are hungry, who I felt were invisible, and make them visible in a way that was so compelling that people would really get what the fuck was going on out there. So that works. And it works in a way that has blown my mind.”
Nonny de la Peña
29
![Page 31: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/31.jpg)
VRChat
31
![Page 32: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were](https://reader034.vdocuments.us/reader034/viewer/2022050118/5f4e790eb6f9633f2c3bcec8/html5/thumbnails/32.jpg)
VRChat
32