focus cues kurt akeley cs248 lecture 20 6 december 2007
Post on 21-Dec-2015
218 views
TRANSCRIPT
Focus Cues
Kurt Akeley
CS248 Lecture 20
6 December 2007
http://graphics.stanford.edu/courses/cs248-07/
CS248 Lecture 20 Kurt Akeley, Fall 2007
Depth cues
Binocular geometric cues:
Stereopsis (retinal-image disparity)
Convergence of the lines of sight
Retinal-image disparity Vergence
Correct retinal-image disparity allows the viewer to “fuse” the scene
CS248 Lecture 20 Kurt Akeley, Fall 2007
Depth cues
Binocular geometric cues:
Stereopsis (retinal-image disparity)
Convergence of the lines of sight
Monocular geometric cues:
Motion parallax
Object size (relative and changing)
Perspective convergence
CS248 Lecture 20 Kurt Akeley, Fall 2007
Depth cues
Binocular geometric cues:
Stereopsis (retinal-image disparity)
Convergence of the lines of sight
Monocular geometric cues:
Motion parallax
Object size (relative and changing)
Perspective convergence
Color cues:
Occlusion
Lighting and shading
Atmospheric effects (attenuation, blue shift)
Texture gradient
CS248 Lecture 20 Kurt Akeley, Fall 2007
Focus matters too!
This photo is of a real scene, not of a model
CS248 Lecture 20 Kurt Akeley, Fall 2007
Outline
Focus
Focus cues
Fixed-viewpoint volumetric display
Experimental results
Practical implications
CS248 Lecture 20 Kurt Akeley, Fall 2007
Focus
CS248 Lecture 20 Kurt Akeley, Fall 2007
Focus
Focus defines a 1-to-1 correspondence between
Object points, which (may) radiate light, and
Image points, where the radiated light converges
In practice image points capture only the object-point radiation that passes through an aperture.
ApertureObject points
Image points
CS248 Lecture 20 Kurt Akeley, Fall 2007
A lens provides the magic
Index of refraction is
greater than one
CS248 Lecture 20 Kurt Akeley, Fall 2007
The correspondence
so si
f
dStraight line through the center of the lens
Object point
Image point
1 1 1
focal length of the lens (m)
object distance (m)
image distance (m)
o i
o
i
f s s
f
s
s
= +
=
=
=
Thin lens equation
CS248 Lecture 20 Kurt Akeley, Fall 2007
Diopters (D)
1Diopters
meters=
CS248 Lecture 20 Kurt Akeley, Fall 2007
Diopter distances
0.67 m
1.0 m
Diopter number-line assignments are
relative to a reference point
2 D
Diopter distances are differences between
number-line assignments:
2 D = 3 D – 1 D
Not computed as the reciprocal of the 0.67 m
“distance” !
1Diopters
meters=
0.5 m
0.33 m
2 D
1 D
3 D
CS248 Lecture 20 Kurt Akeley, Fall 2007
Thin-lens equation (using Diopters)
1 1 1
object distance (m)
image distance (m)
focal length of the lens (m)
o i
o
i
f s s
s
s
f
= +
=
=
=
so si
fObject point
Image point
1 object distance (D)
1 image distance (D)
1 power of the lens (D)
o i
oo
ii
P S S
Ss
Ss
Pf
= +
= =
= =
= =
Reference point is the center of the
lens
CS248 Lecture 20 Kurt Akeley, Fall 2007
Out-of-focus blur
so si
f
to ti
Image plane
1 1 (D)
o o
Et s
= - b ar r Eµ
Object point
ra
rb
E
CS248 Lecture 20 Kurt Akeley, Fall 2007
Depth of field (DOF)
(sometimes also called depth of focus)
DOF is the amount of focus error that is inconsequential
Recall that
Therefore:
DOF measured in Diopters is (almost) invariant with respect to focus distance (So)
For a given aperture radius (ra) and an acceptable blur radius (rb)
“Almost” because there is a slight dependence we are ignoring
DOF is inversely proportional to aperture radius Once the acceptable blur radius is determined
b ar r Eµ
CS248 Lecture 20 Kurt Akeley, Fall 2007
Focus Cues
CS248 Lecture 20 Kurt Akeley, Fall 2007
Focus cues
There are two focus cues:
Accommodation (the focus response of the eye)
Retinal-image blur
Neither is a quality of the light field
Instead they are conditions in the human body that are stimulated by the light field
CS248 Lecture 20 Kurt Akeley, Fall 2007
Accommodation
Accommodation is the focus response of the eye:
Resting focus is at infinity (0 D), or is
corrected with fixed lenses to infinity.
The ciliary muscles contract, allowing the lens to become
more spherical. This increases the power of the
lens, reducing the focal distance.
CS248 Lecture 20 Kurt Akeley, Fall 2007
Human accommodation range
18
0
∞
1
1
2Diopters
meters
3 4
12
13
8
14
All but one Diopter of focal range is within
arm’s reach!
12
112
ChildrenYoung adults
Me
…
CS248 Lecture 20 Kurt Akeley, Fall 2007
Human depth of field
Human depth of field is approximately +/- 0.3 D
The optics of the eye are not perfect
This corresponds to
A DOF from 2 m to infinity, or
A DOF from 10” to 12”
So near-field scenes (with differing depths) are blurry, while far-field scenes are not
18
0
∞
1
1
2Diopters
meters
3 4
12
13
8
14
12
112
…
CS248 Lecture 20 Kurt Akeley, Fall 2007
Tilt-shift miniaturization
CS248 Lecture 20 Kurt Akeley, Fall 2007
Why “tilt-shift”?
Recall that focus is a correspondence
Before Photoshop the effect was created by tilting the image plane of the camera off the main axis:
CS248 Lecture 20 Kurt Akeley, Fall 2007
Make a model appear real
CS248 Lecture 20 Kurt Akeley, Fall 2007
Make a real scene appear miniaturized
CS248 Lecture 20 Kurt Akeley, Fall 2007
A stereo display gets all these right …
Binocular geometric cues:
Stereopsis (retinal-image disparity)
Convergence of the lines of sight
Monocular geometric cues:
Motion parallax
Object size (relative and changing)
Perspective convergence
Color cues:
Occlusion
Lighting and shading
Atmospheric effects (attenuation, blue shift)
Texture gradient
CS248 Lecture 20 Kurt Akeley, Fall 2007
But the focus cues are all wrong
No retinal-image blur
cues
Incorrect accommodation
cue
Vergence and accommodation are decoupled
CS248 Lecture 20 Kurt Akeley, Fall 2007
Volumetric displays fix the focus cues …
And they are autostereoscopic:
Require no tracking of the viewer’s position or orientation
Support multiple simultaneous viewers
Stereopsis is “free”
References:• Downing et al. 1996• Favalora et al. 2002• Lightspace Tech. 2003
CS248 Lecture 20 Kurt Akeley, Fall 2007
But they fail in other critical ways
Binocular geometric cues:
Stereopsis (retinal-image disparity)
Convergence of the lines of sight
Monocular geometric cues:
Motion parallax
Object size (relative and changing)
Perspective convergence
Color cues:
Occlusion
Lighting and shading
Atmospheric effects (attenuation, blue shift)
Texture gradient
No view-dependent shading is possible,
because viewer position is not known
CS248 Lecture 20 Kurt Akeley, Fall 2007
Fixed-viewpoint Volumetric Display
CS248 Lecture 20 Kurt Akeley, Fall 2007
Fixed-viewpoint volumetric display
Fixed-viewpoint:
All geometric and color depth cues are correct
Volumetric:
All focus cues are near-correct
No need for gaze tracking
What’s the catch?
Display is head-mounted
Must track viewer position and orientation Latency is a challenge
Must overcome ergonomic issues
CS248 Lecture 20 Kurt Akeley, Fall 2007
Required volumetric resolution
Autostereoscopic volumetic displays have huge pixel-count requirements in all three dimensions
Fixing the viewpoint allows spatial and depth resolutions to be optimized independently:
Spatial pixel density requirements are unchanged Foveal limit requires 2 pixels/arc min
But depth pixel density is determined by depth of field +/- 0.3 D is more than satisfied by two pixels per diopter
A display with 4 D range has a depth pixel-count of 7 !
1000s
1000s
7
CS248 Lecture 20 Kurt Akeley, Fall 2007
Prototype display design
CS248 Lecture 20 Kurt Akeley, Fall 2007
Prototype display
Bite bar
CS248 Lecture 20 Kurt Akeley, Fall 2007
Demo
CS248 Lecture 20 Kurt Akeley, Fall 2007
Depth blending
CS248 Lecture 20 Kurt Akeley, Fall 2007
Retinal image of a sine wave grating
Eye image from www.wikipedia.com
Lower contrast
CS248 Lecture 20 Kurt Akeley, Fall 2007
Modulation transfer function
CS248 Lecture 20 Kurt Akeley, Fall 2007
Retinal-image contrast with summed images
CS248 Lecture 20 Kurt Akeley, Fall 2007
Experimental Results
CS248 Lecture 20 Kurt Akeley, Fall 2007
Work done at UC Berkeley
Marty Banks
Simon Watt
Ahna R. Girshick
David M. Hoffman
…
http://bankslab.berkeley.edu/
CS248 Lecture 20 Kurt Akeley, Fall 2007
Stimuli
CS248 Lecture 20 Kurt Akeley, Fall 2007
Forced-choice
This ?
Or this ?
CS248 Lecture 20 Kurt Akeley, Fall 2007
Experimental design
CS248 Lecture 20 Kurt Akeley, Fall 2007
Experimental results
CS248 Lecture 20 Kurt Akeley, Fall 2007
Results summary
Correct focus distance results in
Shorter time to “fuse” a depth-corrugation stereogram
Ability to fuse finer depth corrugations
Better estimations of depth People consistently underestimate depth in VR
environments
Less fatigue No forced decoupling of vergence and accommodation
There is no performance penalty for depth blending
For details refer to the publications:
http://bankslab.berkeley.edu/publications.html
CS248 Lecture 20 Kurt Akeley, Fall 2007
Practical implications
CS248 Lecture 20 Kurt Akeley, Fall 2007
Without a fixed-viewpoint volumetric display
Use long viewing distances when possible
Flight simulators use either Large done display
Collimated (infinite focus distance) optics
Minimize accommodation/vergence conflict
High-quality stereo headsets have adjustable focal distance
Set it to the best average distance
Is there hope of a practical fixed-viewpoint volumetric display?
CS248 Lecture 20 Kurt Akeley, Fall 2007
Fixed optics
f
CS248 Lecture 20 Kurt Akeley, Fall 2007
Adaptive optics
Images from www.wikipedia.com
CS248 Lecture 20 Kurt Akeley, Fall 2007
Summary
Focus cues are
Accommodation (focus response)
Retinal blur
Correct focus cues matter
Tilt-shift miniaturization
Experimental results
Display typeCorrect
geometric depth cues
Correct shading depth
cues
Correct focus depth cues
Stereo Autostereoscopic volumetric
Fixed-viewpoint volumetric
CS248 Lecture 20 Kurt Akeley, Fall 2007
Project 3 and game competition
Source code and write-ups due tomorrow at 5 pm
Congratulations to the game competition winners:
1st Place
Balloo
Belinda Gu, Edward Luong, and Joel Galenson
2nd Place
Shootout
Vincent Gire and David Lissmyr
CS248 Lecture 20 Kurt Akeley, Fall 2007
Final exam
Location:
Gates B01
Time:
Thursday 13 December, 7 pm to 9 pm
Material:
We’ll test your mastery of the content of lectures 11-18
But we’ll assume you understand and can apply the material of lectures 1-10 too
Review session:
Gates B03
Friday 7 December (tomorrow), 4:15 pm to 5 pm
CS248 Lecture 20 Kurt Akeley, Fall 2007
Office hours
Kurt:
Not available today after class
Next Tuesday 1:30 pm to 3 pm
Not available next Thursday (the day of the final exam)
CAs:
Check the web site
All:
Will monitor and respond to e-mail questions
CS248 Lecture 20 Kurt Akeley, Fall 2007
Good-bye
Thanks to the CAs !
Andrew, David, and Justin
My goals:
Learn a lot (accomplished)
Convey my understanding to you
Final requests:
Please share your thoughts with me about how the course or slides can be improved In person or e-mail
Please complete the on-line Axess course evaluation The system is open now
It closes at 11:59 pm on Sunday 16 December
CS248 Lecture 20 Kurt Akeley, Fall 2007
End