an introduction to virtual (and other) realitiessweet.ua.pt/bss/aulas/rva-2019/virtual and... ·...
TRANSCRIPT
![Page 1: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/1.jpg)
An Introduction to Virtual (and other) Realities
Universidade de Aveiro Departamento de Electrónica, Telecomunicações e Informática
Virtual and Augmented Reality 2019 Beatriz Sousa Santos
![Page 2: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/2.jpg)
• What is?
• Timeline
• Important aspects
• Applications (old and new examples)
• VR Systems
• Industry perspective
(focused on VR, but also addressing AR…)
2
![Page 3: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/3.jpg)
Ivan Sutherland’s 1965 Vision
“Don’t think of that thing as a screen, think of it as a
window, a window through which one looks
into a virtual world.
The challenge to computer graphics is to make that
virtual world look real, sound real, move and respond
to interaction in real time, and even feel real.”
3
![Page 4: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/4.jpg)
Ivan Sutherland’s 1965 Vision
“Display as a window into a virtual world Improve image generation until the picture looks real Computer maintains world model in real time User directly manipulates virtual objects Manipulated objects move realistically Immersion in virtual world via head-mounted display Virtual world also sounds real, feels real”
4
https://www.youtube.com/watch?v=NtwZXGprxag
![Page 5: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/5.jpg)
The Virtual Reality Triangle
5
(Burdea et al., 2003)
VR is:
• Immersive
• Interactive
• Imagination (to perceive non existing things)
![Page 6: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/6.jpg)
What is VR?
“For better or worse, the label virtual reality stuck to this particular branch of computer graphics. I define a virtual reality experience as any in which the user is effectively immersed in a responsive virtual world. This implies user dynamic control of viewpoint.” “A high-end user-computer interface that involves real-time simulation and interaction through multiple sensorial channels (vision, sound, touch, smell, taste)”. “ A computer generated digital environment that can be experienced and interacted with as if the environment were real”
(Fred Brooks, 1999)
6
(Burdea et al., 2003)
(Jerald, 2015)
![Page 7: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/7.jpg)
VR Timeline
7
http://www.timetoast.com/timelines/32116
Adapted from
![Page 8: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/8.jpg)
Sensorama (Morton Heilig, 1962)
• 3D, wide vision, motion, color, stereo sound, aromas, wind, vibrations
• Lacked interaction…
9 http://en.wikipedia.org/wiki/Sensorama
![Page 9: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/9.jpg)
NASA was pioneer:
“Virtual Visual Environmental Display” (VIVED early 80s)
“Virtual Interface Environment Workstation” (VIEW) 1989
![Page 10: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/10.jpg)
Early VR Demo by Sense8
11
![Page 11: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/11.jpg)
Applications
• Education and training (e.g. military, medical, hazardous industries…)
• Ergonomics evaluation, project review (automotive industry, architecture…)
• Medicine (physical and psychic therapy, surgery planning, pain relief …)
• Culture, entertainment (museums, games, …)
• Data visualization (e.g. science, oil industry)
• Sales and marketing
• …
12
![Page 12: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/12.jpg)
13
Virtual Reality in practice - industry A success case for many years: Automotive industry
Used in : Design, Project review, Ergonomic studies, Production, Marketing Accelerates the process Decreases costs Fosters innovation …
Design at McLaren
https://www.youtube.com
/watch?v=mWaQfjEJIMQ
![Page 13: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/13.jpg)
Automotive industry: other examples
• VR makes possible to:
– multiply the number of innovative hypotheses studied
– limit the number of physical mock-ups
– cut development time and cost
14
http://www.youtube.com/watch?v=umD0IemkXLc&feature=related
New models can be analysed even before any physical prototype exists
https://www.youtube.com/watch?v=BEFfp2QhHZU
![Page 14: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/14.jpg)
Applications in Medicine
• Application areas that went beyond the prototype phase:
– Radiation Treatment, Planning and Control
– Interactive 3D Diagnostic Imaging
– Rehabilitation and Sports Medicine
– Psychiatric and Behavioral Healthcare
– Neurological Evaluation
– Pre-Surgical Planning
– Pain Mitigation
– Medical Education
– Surgical Training
– ...
16
![Page 15: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/15.jpg)
Surgical training
• Surgeons may practice the temporal bone preparation to access the middle ear
• Hight visual realism and haptic feedbak
17
https://www.voxel-man.com/simulators/tempo/
https://www.youtube.com/watch?v=CUOm6fxCJqI
![Page 16: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/16.jpg)
18
Stereoscopic display + glasses
https://www.voxel-man.com/simulators/dental/
Dentistry (e.g. training)
Interaction devices:
- two phanton (force feedback)
- foot pedal
https://www.youtube.
com/watch?v=CB_v
dW6K42o
![Page 17: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/17.jpg)
Physical Therapy
19
A stroke patient interacts with a virtual reality environment using an electronic glove to "pour tea" during a therapy session University of Chicago
![Page 18: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/18.jpg)
20
Mini-games to help recover arm movement for Stroke patients
DETI/IEETA + Centro Rovisco Pais
![Page 19: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/19.jpg)
21
Interior design
https://www.youtube.com/watch?v=y-fYCnGICS4
![Page 20: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/20.jpg)
• Industry 4.0 offers many opportunities and chalenges for VR and AR
22
https://www.i-scoop.eu/industry-40-virtual-reality-vr-augmented-reality-ar-trends/
![Page 21: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/21.jpg)
Product Design Process
23 https://www.youtube.com/watch?v=TiY45xUamI0
Using the HTC Vive Virtual Reality (VR) system in the product design process
for an Industrial Designer creating an exterior for a industrial laser cutter.
![Page 22: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/22.jpg)
24
Training and Safety
https://www.youtube.com/watch?v=y-fYCnGICS4
Emergency evacuation and Accident simulation
![Page 23: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/23.jpg)
Training: Coal mining industry
25
http://www.3ds.com/fileadmin/PRODUCTS/3DVIA/3DVIAVirtools/demoshowcase/html/demo.html?br=1&rub=2&srub=8&de=245#
![Page 24: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/24.jpg)
Several degrees of immersion
• Desktop VR
• Semi-immersive VR
• Fully immersive VR
26 (S.H. Choi and H.H. Cheun, 2008)
![Page 25: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/25.jpg)
Potential benefits of Immersion
• Immersion can offer benefits beyond a realistic experience:
• Spatial understanding can result in greater effectiveness in:
– scientific visualization,
– design review,
– virtual prototyping
• Decrease in information clutter and increase the environment’s comprehensibility (increased FOV, FOR, and display resolution)
27
(Bowman and McMahan, 2007)
![Page 26: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/26.jpg)
• “ A sense of “being there” inside a space even when physically located in a different location” (Jerald, 2015)
• It is difficult to describe as it is an psychological state
• Is a function of the user and the immersion; it is an illusion
• Definition by the International Society for Presence Research (2000) :
“is a psychological state or subjective perception in which even though part or all of an individual’s current experience is generated by and/or filtered through human made technology, part or all of the individual’s perception fails to accurately acknowledge the role of the technology in the experience”
28
Presence
![Page 27: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/27.jpg)
Virtual Reality Systems
29
(Jerald, 2016)
Interaction
devices &
techniques
![Page 28: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/28.jpg)
Crucial technologies for VR
• Visual/graphics displays that immerse the user in the virtual world and block out from the real world
• Graphics rendering system that generates images (++ frames/s)
• Tracking system that continually reports user’s position and orientation
• Database construction and maintenance system for building and maintaining models of the virtual world
30
![Page 29: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/29.jpg)
• Interaction devices allowing users to interact with virtual objects
• Interaction techniques that substitute for the real interactions possible with the physical world
• Display of synthesized sound including directional sound and simulated sound fields
(if possible)
• Display of synthesized forces and other haptic sensations
31
![Page 30: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/30.jpg)
VR System
32
(Burdea et al., 2004)
• I/O devices: - trackers, interaction devices, ...
- displays (visual, sound, haptic,…)
• Virtual Reality engine (architecture) • Software for virtual object modeling: - geometry, texture, - intelligent behavior - physical modeling (inertia, hardness,...) • Users and their tasks (human factors)
![Page 31: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/31.jpg)
Input devices
• Trackers: – Mechanical – Magnetic (AC, DC) – Optical – Ultrasonic – Hybrid inertial
• Navigation and manipulation interfaces:
– Tracker-based – Trackballs – 3D probes
• Gesture interfaces:
– Cyberglove – Various sensors ...
33
![Page 32: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/32.jpg)
• Trackers: – Magnetic (AC, DC) – Optical – Ultrasonic – Inertial, – Mechanical – Hybrid ...
Interaction
devices &
techniques
![Page 33: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/33.jpg)
36
• Navigation and manipulation devices:
– Tracker-based
– Trackballs
– 3D probes, ...
• Gesture interfaces:
– Gloveone
– Cyberglove
https://www.neurodigital.es/gloveone/
http://www.cyberglovesystems.com/
![Page 34: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/34.jpg)
Very sophisticated and expensive devices
37
http://www.cyberglovesystems.com/
http://www.cyberglovesystems.com/cybertouch/
http://www.cyberglovesystems.com/cyberglove-iii
![Page 35: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/35.jpg)
And other affordable input devices you know from other contexts:
• Wiimote
• Kinect
38
https://en.wikipedia.org/wiki/Wii_Remote
Item is no longer available
![Page 36: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/36.jpg)
Output devices
• Graphics displays: – Personal (HMDs, HSD, DSD, ...) – Large volume displays (monitor-based, projector-based)
• Sound displays:
– Speaker-based 3D sound
• Haptic displays: – Tactile feedback interfaces (mouses, gloves, ...) – Force feedback interfaces (force-feedback joysticks, haptic arms, ...)
39
Speech and brain interfaces?
![Page 37: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/37.jpg)
Graphics Displays
• HMDs
– single user; very immersive
– small field-of-view
– May have poor ergonomics
(weight, cables)
40
http://home.ca.inter.net/~
milgram/
https://www.inition.co.uk/extraordinary-
technology/head-mounted-displays/
![Page 38: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/38.jpg)
Evolving to standalone (all in one) systems…
• Oculus Quest specs:
• Display panel: OLED.
• Display resolution: 1440 x 1600 per eye (Oculus Rift had 1080×1200 per eye)
• 72Hz refresh rate.
• Qualcomm Snapdragon 835 processor.
• 4GB RAM.
• Lithium-ion battery with 2-3 hours playtime, depending on what you are playing.
• 6 degrees of freedom head and hand tracking.
• Two touch controllers.
• ~400USD – May/2019
41 https://en.wikipedia.org/wiki/Oculus_Quest
![Page 39: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/39.jpg)
Graphics Displays
• Projection systems (CAVE like sysmems)
– wide, surrounding field of view
– shared experience to a small group
– cost of multiple image-generation
– space requirements
– reduced contrast and color saturation
– brightness limitations
– corner and edge effects
42
http://www.antycipsimulation.com/
![Page 40: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/40.jpg)
Sound
• In addition to the visual and tactile displays, sound:
– enhances the presence
– enhances the display of spatial information
– can convey simulated properties of elements of the environment
(e.g. mass, force of impact...)
– can be useful in designing systems where users monitor several communication channels (selective attention)
44
![Page 41: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/41.jpg)
Haptic interfaces
• From Greek Hapthai meaning the sense of touch
• Increase in realism
• but devices: high cost, take workspace, safety concerns, high bandwidth
47
https://www.youtube.com/watch?time_continue=34&v=C_rHAbJJggM
![Page 42: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/42.jpg)
Haptic devices
– Tactile feedback interfaces (mouses, gloves, ...) – Force feedback interfaces (force-feedback joysticks, PHANTOM, CyberGrasp...)
49
http://www.novint.com/index.php/products/novintfalcon
http://www.sensable.com/haptic-phantom-omni.htm
http://www.cyberglovesystems.co
m/cybergrasp/
https://www.inition.co.uk/product/haption-virtuose/?%3E
![Page 43: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/43.jpg)
Affordable: Tactile feedback mouse
• Vibrations occur in zz minimizing the negative effect on the x,y mouse accuracy
• The host s/w detects contact between the cursor and hapticly enabled borders, icons…
• Haptic commands indicating the onset and type feedback are sent to the mouse processor
• The processor converts commands into vibration and drives the actuator
50
(Burdea et al., 2004)
Gamming mouse; 100USD
https://steelseries.com/gaming-mice/rival-700
![Page 44: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/44.jpg)
51
Displays for other senses
Experiments on smell and taste
![Page 45: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/45.jpg)
The field evolves
• Every year new devices appear
Some quite “weird”!
52
![Page 46: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/46.jpg)
Augmented versus Virtual Reality
• AR is a natural evolution from VR technology
• The major limitation of VR is that it is not easy to fully and accurately model the actual environment
• Does not need to model the entire real world
• AR enhances an existing environment rather than replacing, reduces the high cost of fully immersive VR environments and avoids time-consuming remodeling of complex real objects
53
![Page 47: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/47.jpg)
Augmented Reality
• “Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world
environment whose elements are augmented by computer-generated sensory
input such as sound, video, graphics or GPS data.” (Wikipedia)
• “Augmented Reality (AR) is a variation Virtual Reality …
VR completely immerse a user inside a synthetic environment, … While
immersed, the user cannot see the real world around him.
… AR allows the user to see the real world, with virtual objects superimposed
upon or composited with the real world.
…AR supplements reality, rather than completely replacing it. “
(Azuma, 1997) 54
![Page 48: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/48.jpg)
Reality Virtuality “Continuum”
“Augmenting natural feedback to the operator with simulated cues”
55
(Milgram et al., 1994)
Mixed Reality (MR)
Real Environment Augmented Reality Augmented Virtuality Virtual Environment
(Steinicke et a., 2009)
![Page 49: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/49.jpg)
• Azuma (1997) defines AR as systems that has the following three characteristics:
– 1) Combines real and virtual
– 2) Interactive in real time
– 3) Registered in 3-D
57
![Page 50: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/50.jpg)
Relevant issues in AR
• Registration
• Latency
• Calibration
• Human factors …
58
![Page 51: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/51.jpg)
Yet Other Realities: Altered Reality (Augmented + Diminished)
• Leao, C.W.M. Lima, J.P. Teichrieb, V., Albuquerque, E.S., Kelner, J. , "Demo — Altered reality: Augmenting and diminishing reality in real time," IEEE Virtual Reality Conference, 2011, pp.259-260
59
![Page 52: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/52.jpg)
What is the current state of VR/AR? Industry perspective
60
Expanding from a research field into commercially viable technologies
https://www.gartner.com/smarterwithgartner/5-trends-appear-on-the-
gartner-hype-cycle-for-emerging-technologies-2019/
/
In 2019 VR and AR no longer appear, they have reached the plateau of productivity
![Page 53: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/53.jpg)
The Industry perspective
– 1. A new technology creates expectations; it is investigated and its potential explained
– 2. Expectations peak; the technology becomes overestimated
– 3. Failures and high cost lead to disappointment
– 4. Technology is consolidated and expectations rise again
– 5. Mainstream productivity is attained
61
Gartner Hype cycle:
https://www.gartner.com/smarterwithgartner/5-trends-appear-on-the-
gartner-hype-cycle-for-emerging-technologies-2019/
/
![Page 54: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/54.jpg)
62
![Page 55: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/55.jpg)
63
VR no longer appears: it has
reached the productivity platform
2018
VR and AR in the latest years
![Page 56: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/56.jpg)
64
http://www.gartner.com/smarterwithgartner/top-trends-in-the-gartner-hype-
cycle-for-emerging-technologies-2017/
2017
![Page 57: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/57.jpg)
65
http://www.gartner.com/smarterwithgartner/top-trends-in-the-gartner-hype-
cycle-for-emerging-technologies-2017/
2017
![Page 58: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/58.jpg)
What about VR currently? In my opinion:
• There is a continuum of realities
• It is more consolidated and much more affordable
• It has passed the “hype and disappointment phases”
• There is a range of VR settings with very different costs
• It works and is useful in specific applications
• It is still not easy to integrate a complete solution
• It still has human factors challenges
• It is coming to the home soon
69
Don’t forget AR!
![Page 59: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/59.jpg)
To keep up with the latest developments: Conferences
• IEEE Virtual Reality (VR) (since 1993)
• ACM Symposium on Virtual Reality Software and Technology (VRST) (since
1994)
• Eurographics Workshop on Virtual Environments (since 1995)
• IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (since 2002)
• IEEE World Haptics Conference (WHC) (since 2005)
• IEEE 3D User Interfaces (3DUI) (since 2006)
• IS&T/SPIE Electronic Imaging
• SIGGRAPH Emerging Technologies
• …
• http://www.wikicfp.com/cfp/call?conference=virtual%20reality
70
![Page 60: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/60.jpg)
Bibliography - Books
• Jerald, J., The VR Book: Human-Centered Design for Virtual Reality, ACM and Morgan & Claypool, 2016
• G. Burdea and P. Coiffet, Virtual Reality Technology, 2nd ed. Jonh Wiley and
Sons, 2003
• La Valle, S., Virtual Reality, Cambridge University Press, 2017 http://vr.cs.uiuc.edu • LaViola, J., Kruijff, E., McMahan, R., Bowman, D., Poupyrev, I., 3D User
Interfaces: Theory and Practice, 2nd ed. Addison Wesley Professional, 2017 • Craig, A., Sherman, W., Will, J., Developing Virtual Reality Applications:
Foundations of Effective Design, Morgan Kaufmann, 2009
71
![Page 61: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/61.jpg)
Google Trends: Virtual Reality and Augmented Reality
72
Christmas!
![Page 62: An Introduction to Virtual (and other) Realitiessweet.ua.pt/bss/aulas/RVA-2019/Virtual and... · Augmented Reality • “Augmented reality (AR) is a live, direct or indirect, view](https://reader036.vdocuments.us/reader036/viewer/2022081406/5f1662d2e300a52e206d2529/html5/thumbnails/62.jpg)
73