output devices - visualgogo/courses/cs525h/slides/...output devices - visual robert w. lindeman...
TRANSCRIPT
![Page 1: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/1.jpg)
CS-525H: Immersive HCI
Output Devices - Visual
Robert W. Lindeman
Worcester Polytechnic InstituteDepartment of Computer Science
![Page 2: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/2.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
2
OverviewHere we are
concerned withtechnology forstimulating thesenses
![Page 3: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/3.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
3
Motivation We need to display the state of the world to the
user Display: a method of presenting information to any of
the senses
We need to display the user to the user (maybe) We need to feed each sense appropriately We need to feed multiple senses in concert
Display for one sense shouldn't get in the way of displayfor another sense
May need to quickly don/doff displays
![Page 4: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/4.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
4
Some Things to RememberHumans are animals, and hence, have
evolved over time.Evolutionary forces have guided the
development of our senses.Displays that leverage this fact have a
better shot of being effective.
![Page 5: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/5.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
5
General Types of DisplaysThe senses
Visual Auditory Haptic Olfactory Gustatory
Display anchoringWorld-fixed displaysBody-worn displaysHand-held displays
![Page 6: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/6.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
6
Visual Display TypesWorld-fixed displays
Fishtank VR Projection VR
Body-worn displays Opaque HMDs Transparent HMDs
Hand-held displays Palm VR Boom-mounted screens Mobile devices
![Page 7: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/7.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
7
Visual Display Types Monitors
CRT, Plasma, LCD
Surround-screens (e.g., CAVEs) Tabletops Hemispheric displays Head-mounted displays (HMDs) Arm-mounted displays Virtual retinal displays Autostereoscopic displays 3D displays
![Page 8: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/8.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
8
Visual DisplaysCAVEs
![Page 9: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/9.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
9
Visual Displays (cont.)CAVE
![Page 10: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/10.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
10
Head-Mounted Displays (HMDs)
![Page 11: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/11.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
11
Visual CuesDepth is the main thing added by VR to
more-traditional displays How do we perceive depth?
Monoscopic cuesStereoscopic cuesMotion-depth cuesPhysiological cues
![Page 12: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/12.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
12
Monoscopic CuesOverlap (Interposition)Shading & shadowsSizeLinear perspectiveTexture gradientHeight in the imageAtmospheric effectsBrightness
![Page 13: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/13.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
13
Stereoscopic CuesThis is based on the parallax of objects
appearing in two images.Camera 1 / camera 2 effectOnly good within about 5 meters of
viewer
![Page 14: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/14.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
14
Motion Depth CuesChanging relative position of head and
objectsCan be user and/or object moving
Train leaving a station Use proprioception to disambiguate
http://www.youtube.com/watch?v=1AZAbSXmeoI
![Page 15: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/15.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
15
Motion Depth Cues (cont.)Head movement
![Page 16: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/16.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
16
Physiological CuesThe eye changes during viewingAccommodation
Muscular changes of the eye
Convergence Movements to bring images to same location
on both retinas
![Page 17: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/17.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
17
Properties of Visual Displays Color Spatial resolution Contrast Brightness Number of channels Focal distance Opacity Masking Field of view Field of Regard
Head position info Graphics latency Frame rate
![Page 18: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/18.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
18
Number of Display ChannelsSpatial multiplexing
Different image in front of each eye
Temporal multiplexing (time interlacing) Use shutter glasses
Polarization multiplexing Use polarized glasses
Spectral multiplexing Red/blue left-eye/right-eye images
Binocular monoscopicStereo takes twice the resources!
![Page 19: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/19.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
19
MaskingHow physical objects block virtual onesCAVE: Hands can break effectHMD: Not at allFishtank: Display edges/bezel can break
effect
http://www.youtube.com/watch?v=Jd3-eiid-Uw&fmt=18
![Page 20: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/20.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
20
Field of View vs. Field of RegardField of view (FOV)
How much of the scene (in degrees) is visibleat any given time
Field of regard (FOR) Amount of space (in percent) of the virtual
world currently surrounding the user
Examples CAVE: 200° FOV facing forward, 75% FOR HMD: 100° FOV, 100% FOR
![Page 21: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/21.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
21
Hand-Held DisplaysPDAs are becoming more powerfulCall phones have cameras
Can do AR
Apple iPhone 4(2010)
Apple iPad(2010)
Motorola DROID(2009)
Sony PlayStationPortable (2004)
Nintendo DS Lite(2006)
![Page 22: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/22.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
22
Change BlindnessThere is so much information for the
brain to process, we need to filterChange blindness is when we miss things
that change from one instant to another http://www.youtube.com/watch?v=mAnKvo-fPs0
A public service announcement: http://www.youtube.com/watch?v=Ahg6qcgoay4&NR=1
Next example from: http://www.psych.ubc.ca/~rensink/flicker/ Show Movie
![Page 23: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/23.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
23
Change Blindness
![Page 24: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/24.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
24
Change Blindness (answer)
![Page 25: Output Devices - Visualgogo/courses/cs525H/slides/...Output Devices - Visual Robert W. Lindeman Worcester Polytechnic Institute Department of Computer Science gogo@wpi.edu. R.W. Lindeman](https://reader034.vdocuments.us/reader034/viewer/2022050508/5f996fb97308da14f4648bde/html5/thumbnails/25.jpg)
R.W. Lindeman - WPI Dept. of Computer ScienceInteractive Media & Game Development
25
Change Blindness (answer)