computer graphics psychophysics heinrich h. bülthoff max-planck-institute for biological...
TRANSCRIPT
![Page 1: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/1.jpg)
Computer Graphics Psychophysics
Heinrich H. Bülthoff
Max-Planck-Institute forBiological Cybernetics
Tübingen, Germany
Heinrich H. Bülthoff
Max-Planck-Institute forBiological Cybernetics
Tübingen, Germany
![Page 2: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/2.jpg)
What is psychophysics?
A research strategy to understand perception and A research strategy to understand perception and performance by testing the relationship between the performance by testing the relationship between the psychicpsychic (what an observer sees and reports) and the (what an observer sees and reports) and the physicalphysical (patterns of light entering the eye). (patterns of light entering the eye).
A research strategy to understand perception and A research strategy to understand perception and performance by testing the relationship between the performance by testing the relationship between the psychicpsychic (what an observer sees and reports) and the (what an observer sees and reports) and the physicalphysical (patterns of light entering the eye). (patterns of light entering the eye).
![Page 3: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/3.jpg)
Method
Show and tell :Show and tell :– static imagesstatic images
– video animationsvideo animations
– vision + haptics vision + haptics
– virtual environmentsvirtual environments
Show and tell :Show and tell :– static imagesstatic images
– video animationsvideo animations
– vision + haptics vision + haptics
– virtual environmentsvirtual environments
![Page 4: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/4.jpg)
Basic Question:Basic Question:
What image information does the brain use and What image information does the brain use and what does it ignore ? what does it ignore ?
Applied Question:Applied Question:
How can we render images that convey only the How can we render images that convey only the information that the brain uses? information that the brain uses?
Basic Question:Basic Question:
What image information does the brain use and What image information does the brain use and what does it ignore ? what does it ignore ?
Applied Question:Applied Question:
How can we render images that convey only the How can we render images that convey only the information that the brain uses? information that the brain uses?
Main questions
![Page 5: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/5.jpg)
Examples of vision problems
– RecognitionRecognition
– Depth perceptionDepth perception
– NavigationNavigation
– (Haptics)(Haptics)
– RecognitionRecognition
– Depth perceptionDepth perception
– NavigationNavigation
– (Haptics)(Haptics)
![Page 6: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/6.jpg)
Computer Graphics Psychophysics at the MPI Tuebingen
• Recognition Recognition
• Shape Shape Perception Perception
• HapticsHaptics
• DrivingDriving
• NavigationNavigation
• Recognition Recognition
• Shape Shape Perception Perception
• HapticsHaptics
• DrivingDriving
• NavigationNavigation
![Page 7: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/7.jpg)
Object recognition – how does it work?
Naïve theory :Naïve theory :
First, the brain computes an object’s 3-D shape.First, the brain computes an object’s 3-D shape.
Then the brain matches the 3-D shape to previously Then the brain matches the 3-D shape to previously seen shapes that are stored in memory. seen shapes that are stored in memory.
image z-buffer 3-D shape memoryimage z-buffer 3-D shape memory
Naïve theory :Naïve theory :
First, the brain computes an object’s 3-D shape.First, the brain computes an object’s 3-D shape.
Then the brain matches the 3-D shape to previously Then the brain matches the 3-D shape to previously seen shapes that are stored in memory. seen shapes that are stored in memory.
image z-buffer 3-D shape memoryimage z-buffer 3-D shape memory
![Page 8: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/8.jpg)
Image-based RecognitionAlternative Theory:Alternative Theory:
The visual system ignores depth perception when recognizing an The visual system ignores depth perception when recognizing an object. Rather, the visual system recognizes an object directly object. Rather, the visual system recognizes an object directly from its image. from its image.
z-buffer (depth perception)z-buffer (depth perception)
imageimage
image memory (recognition)image memory (recognition)
Alternative Theory:Alternative Theory:
The visual system ignores depth perception when recognizing an The visual system ignores depth perception when recognizing an object. Rather, the visual system recognizes an object directly object. Rather, the visual system recognizes an object directly from its image. from its image.
z-buffer (depth perception)z-buffer (depth perception)
imageimage
image memory (recognition)image memory (recognition)
![Page 9: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/9.jpg)
Recognition of Biological Motion
Recognition of point-like walkerRecognition of point-like walker
![Page 10: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/10.jpg)
Biological Motion PerceptionJohansson (1911-1998)
Walter:
insert orig. johannson movie here
30 sec max
Walter:
insert orig. johannson movie here
30 sec max
![Page 11: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/11.jpg)
Depth perception from stereo is ignored Bülthoff, Bülthoff and Sinha (Nature Neuroscience 1998)
Recognition is Recognition is unaffected byunaffected byscrambling the depthscrambling the depth structure structure
2D motion 2D motion pattern and pattern and not 3D structure not 3D structure is used is used for recognitionfor recognition
Z
y
zx
![Page 12: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/12.jpg)
Image-based RecognitionEvidence from:
• Psychophysics (Buelthoff, MPI Tuebingen)Psychophysics (Buelthoff, MPI Tuebingen)
– limited generalization (30°) despite full 3D informationlimited generalization (30°) despite full 3D information
• Psychophysics (Buelthoff, MPI Tuebingen)Psychophysics (Buelthoff, MPI Tuebingen)
– limited generalization (30°) despite full 3D informationlimited generalization (30°) despite full 3D information
• Physiology (Logothetis, MPI Tuebingen)Physiology (Logothetis, MPI Tuebingen)
– image-specific neurons in trained monkeys image-specific neurons in trained monkeys
• Physiology (Logothetis, MPI Tuebingen)Physiology (Logothetis, MPI Tuebingen)
– image-specific neurons in trained monkeys image-specific neurons in trained monkeys
• Theory (Poggio, MIT)Theory (Poggio, MIT)
– image-interpolation networksimage-interpolation networks
• Theory (Poggio, MIT)Theory (Poggio, MIT)
– image-interpolation networksimage-interpolation networks
• Rendering Application (Blanz & Vetter, MPI Tuebingen)Rendering Application (Blanz & Vetter, MPI Tuebingen)
– image-based face synthesisimage-based face synthesis
• Rendering Application (Blanz & Vetter, MPI Tuebingen)Rendering Application (Blanz & Vetter, MPI Tuebingen)
– image-based face synthesisimage-based face synthesis
![Page 13: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/13.jpg)
One Object - Two InterpretationsMarkus Raetz
![Page 14: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/14.jpg)
Man or Hare ? Markus Raetz
![Page 15: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/15.jpg)
Why does the brain make assumptions?
Images are ambiguous. Any image Images are ambiguous. Any image can be explained by several can be explained by several combinations of 3-D shape, material combinations of 3-D shape, material and lighting.and lighting.
Images are ambiguous. Any image Images are ambiguous. Any image can be explained by several can be explained by several combinations of 3-D shape, material combinations of 3-D shape, material and lighting.and lighting.
![Page 16: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/16.jpg)
e.g. The Necker Cube
![Page 17: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/17.jpg)
e.g. The Necker Cube
view from above view from below
![Page 18: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/18.jpg)
e.g. Depth-reversal ambiguity in shading
A valley illuminated from the right looks the same as a A valley illuminated from the right looks the same as a hill illuminated from the left.hill illuminated from the left.
A valley illuminated from the right looks the same as a A valley illuminated from the right looks the same as a hill illuminated from the left.hill illuminated from the left.
hillvalley
![Page 19: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/19.jpg)
Prior assumption about light source
![Page 20: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/20.jpg)
Mould of a footprint ?
![Page 21: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/21.jpg)
Assumption that light source is stationary
![Page 22: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/22.jpg)
![Page 23: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/23.jpg)
Prior assumptions about shape
The Hollow Mask IllusionThe Hollow Mask IllusionThe Hollow Mask IllusionThe Hollow Mask Illusion
![Page 24: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/24.jpg)
3 prior assumptions
11. light from above 2. viewpoint from above . light from above 2. viewpoint from above
3. shape is convex3. shape is convex
11. light from above 2. viewpoint from above . light from above 2. viewpoint from above
3. shape is convex3. shape is convex
![Page 25: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/25.jpg)
Example: failure of all 3 prior assumptions
shape is concave viewpoint from below shape is concave viewpoint from below
light from below light from below
shape is concave viewpoint from below shape is concave viewpoint from below
light from below light from below
![Page 26: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/26.jpg)
“ Measuring Visual Shape using Computer Graphics Psychophysics” (see Workshop proceedings)
convex concaveconvex concave
(face) (mask)(face) (mask)
convex concaveconvex concave
(face) (mask)(face) (mask)
![Page 27: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/27.jpg)
Procedure
![Page 28: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/28.jpg)
![Page 29: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/29.jpg)
Task: hill or valley ?
![Page 30: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/30.jpg)
Assumption 1 : light direction
lightlight
fromfrom
aboveabove
lightlight
fromfrom
belowbelow
lightlight
fromfrom
aboveabove
lightlight
fromfrom
belowbelow
![Page 31: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/31.jpg)
Assumption 2 : viewpoint direction(case 1 - convex shape)
view from aboveview from above
view from belowview from below
view from aboveview from above
view from belowview from below
![Page 32: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/32.jpg)
Assumption 2 : viewpoint direction(case 2 – concave shape)
view from belowview from below
view view from abovefrom above
view from belowview from below
view view from abovefrom above
![Page 33: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/33.jpg)
Data : per cent correct scores (see workshop proceedings for more details)
87(best)
15(worst)
64 39
![Page 34: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/34.jpg)
Lessons for rendering
Illumination and viewpoint should be from above, Illumination and viewpoint should be from above, especiallyespecially if the surface is concave. if the surface is concave.
Otherwise :Otherwise :
- Shading will look weird. Shading will look weird.
- Perceived shape will be incorrect.Perceived shape will be incorrect.
Illumination and viewpoint should be from above, Illumination and viewpoint should be from above, especiallyespecially if the surface is concave. if the surface is concave.
Otherwise :Otherwise :
- Shading will look weird. Shading will look weird.
- Perceived shape will be incorrect.Perceived shape will be incorrect.
![Page 35: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/35.jpg)
Weird shading
Frankenstein monster illuminated from below.Frankenstein monster illuminated from below.Frankenstein monster illuminated from below.Frankenstein monster illuminated from below.
![Page 36: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/36.jpg)
Face Recognition
Cyberware Scanner Texture Map Shape MapCyberware Scanner Texture Map Shape Map Cyberware Scanner Texture Map Shape MapCyberware Scanner Texture Map Shape Map
![Page 37: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/37.jpg)
MPI 3-D Face Database
![Page 38: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/38.jpg)
View-synthesis from a single imageVolker Blanz and Thomas Vetter (SIGGRAPH ‘99)
Input
Output
W2*+W1* W3*+ W4*+ +…..=
=W2*+W1* W3*+ W4*+ +…..
![Page 39: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/39.jpg)
All views from a single image
![Page 40: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/40.jpg)
Synthetic ActorsVolker Blanz und Thomas Vetter (SIGGRAPH 1999)
![Page 41: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/41.jpg)
Audrey Hepburn (1929-1993)
New Hat + New Illumination
Original New View
![Page 42: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/42.jpg)
Do you recognize her ?
Mona Lisa New View
![Page 43: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/43.jpg)
Virtual Tuebingen
![Page 44: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/44.jpg)
Summary (Visual Recogntion)
• Visual recognition is based on images, not on 3-D geometry.Visual recognition is based on images, not on 3-D geometry.
– More texture memory not polygonsMore texture memory not polygons
Better to apply a texture map from a previously seen image than to re-render an object or scene from a new viewpoint or under a new lighting condition.
• Visual recognition is based on images, not on 3-D geometry.Visual recognition is based on images, not on 3-D geometry.
– More texture memory not polygonsMore texture memory not polygons
Better to apply a texture map from a previously seen image than to re-render an object or scene from a new viewpoint or under a new lighting condition.
![Page 45: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/45.jpg)
Summary
• Does the brain use a depth buffer?
– Yes: for shape perception (shape from shading)
– No: for recognition (biological motion)
• Stereo goggles not necessary for recognition.
• Does the brain use a depth buffer?
– Yes: for shape perception (shape from shading)
– No: for recognition (biological motion)
• Stereo goggles not necessary for recognition.
![Page 46: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/46.jpg)
Summary (3-D Shape Perception)
• Shape from shading is strongly affected by prior assumptions Shape from shading is strongly affected by prior assumptions hard wired into the brain.hard wired into the brain.
• Photorealistic renderings will look weird if the scene Photorealistic renderings will look weird if the scene model or viewing parameters are inconsistent with these model or viewing parameters are inconsistent with these assumptions. assumptions.
• Shape from shading is strongly affected by prior assumptions Shape from shading is strongly affected by prior assumptions hard wired into the brain.hard wired into the brain.
• Photorealistic renderings will look weird if the scene Photorealistic renderings will look weird if the scene model or viewing parameters are inconsistent with these model or viewing parameters are inconsistent with these assumptions. assumptions.
![Page 47: Computer Graphics Psychophysics Heinrich H. Bülthoff Max-Planck-Institute for Biological Cybernetics Tübingen, Germany Heinrich H. Bülthoff Max-Planck-Institute](https://reader031.vdocuments.us/reader031/viewer/2022020417/56649e8a5503460f94b8ed48/html5/thumbnails/47.jpg)
100100
light-from-abovelight-from-above
light-light-from-belowfrom-below
PercentPercent
correct 50correct 50 view-from-above view-from-above
view-view-from-belowfrom-below
convexconvex
concaveconcave
Data (see workshop proceedings)
0