adriana pres scenes.ppt - department of computer … [fei-fei 2005] l. fei-fei and p. perona. a...
TRANSCRIPT
![Page 1: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/1.jpg)
Scene RecognitionScene Recognition
Adriana KovashkaAdriana KovashkaUTCS, PhD studentUTCS, PhD student
![Page 2: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/2.jpg)
ProblemProblemProblemProblem
• StatementStatement– Distinguish between different types of scenes
Applications• Applications– Matching human perception– Understanding the environment
• Indexing of images / videoR b ti• Robotics
– Graphics• In painting• In-painting
![Page 3: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/3.jpg)
BackgroundBackgroundBackgroundBackground
• Definition of a sceneDefinition of a scene – “[A] scene is mainly characterized as a place
in which we can move“ [Oliva 2001]in which we can move [Oliva 2001]• Assumptions
Human categorization– Human categorization• Approaches
– Parsing of the scene – as a whole, or in parts
![Page 4: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/4.jpg)
Coast [Oliva 2001]
Mountain [Oliva 2001]
![Page 5: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/5.jpg)
Inside City [Oliva 2001]
Street [Oliva 2001]
![Page 6: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/6.jpg)
Kitchen [Lazebnik 2006]
Industrial [Lazebnik 2006]
![Page 7: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/7.jpg)
Scene?Scene?Scene?Scene?
![Page 8: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/8.jpg)
Scene?Scene?Scene?Scene?
![Page 9: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/9.jpg)
Urban or natural?Urban or natural?Urban or natural?Urban or natural?
![Page 10: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/10.jpg)
Urban or natural?Urban or natural?Urban or natural?Urban or natural?
![Page 11: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/11.jpg)
Spatial Envelope [Oliva 2001]Spatial Envelope [Oliva 2001]Spatial Envelope [Oliva 2001]Spatial Envelope [Oliva 2001]
• Inspiration from human perceptionInspiration from human perception– Naturalness, openness, roughness
Expansion ruggedness– Expansion, ruggedness• Holistic, no recognition of objects • Three levels
– “cars and people” vs. “street” vs. “urban environment”
![Page 12: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/12.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
• Scene modelingScene modeling– Discrete Fourier Transform
– Windowed Fourier Transform[Oliva 2001]
[Oliva 2001]
![Page 13: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/13.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
– Principal Components AnalysisPrincipal Components Analysis
[Oliva 2001]
![Page 14: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/14.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
[Oliva 2001]
![Page 15: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/15.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
• Properties of the spatial envelopeProperties of the spatial envelope– Discriminant spectral template (DST)
• Relates spectral components to properties of the• Relates spectral components to properties of the spatial envelope
• Parameter d learned through matching of feature vectors and property values
– Windowed discriminant spectral template (WDST)(WDST)
![Page 16: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/16.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
[Oliva 2001]
![Page 17: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/17.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
[Oliva 2001]
![Page 18: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/18.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
• ResultsResults – Scene properties
[Oliva 2001]
![Page 19: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/19.jpg)
Spatial Spatial Envelope Envelope (cont’d)(cont’d)
[Oliva 2001]
![Page 20: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/20.jpg)
Spatial Spatial Envelope Envelope (cont’d)(cont’d)
[Oliva 2001]
![Page 21: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/21.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
– ClassificationClassification• K-nn• 4 out of 7 neighbors g
picked by humans
[Oliva 2001]
![Page 22: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/22.jpg)
Spatial Envelope (cont’d)Spatial Envelope (cont’d)Spatial Envelope (cont d)Spatial Envelope (cont d)
• StrengthsStrengths– Higher-level descriptions
Low dimensionality– Low dimensionality– Invariance to object composition
Weak local information– Weak local information• Weaknesses
– Significant number of human labels
![Page 23: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/23.jpg)
[Oliva 2001]
![Page 24: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/24.jpg)
Spatial Pyramid [Lazebnik 2006]Spatial Pyramid [Lazebnik 2006]Spatial Pyramid [Lazebnik 2006]Spatial Pyramid [Lazebnik 2006]
• Global locally orderlessGlobal, locally orderless• Bag-of-features
E t i f P id M t h K l i 2 d• Extension of Pyramid Match Kernel in 2-d• Regular clustering of features
![Page 25: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/25.jpg)
Spatial Pyramid (cont’d)Spatial Pyramid (cont’d)Spatial Pyramid (cont d)Spatial Pyramid (cont d)
[Grauman 2005] as quoted in [Lazebnik 2006][Lazebnik 2006]
[Lazebnik 2006][Lazebnik 2006]
![Page 26: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/26.jpg)
Spatial Pyramid (cont’d)Spatial Pyramid (cont’d)Spatial Pyramid (cont d)Spatial Pyramid (cont d)
[Lazebnik 2006]
![Page 27: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/27.jpg)
Spatial Pyramid (cont’d)Spatial Pyramid (cont’d)Spatial Pyramid (cont d)Spatial Pyramid (cont d)
[Lazebnik 2006]
![Page 28: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/28.jpg)
Spatial Pyramid (cont’d)Spatial Pyramid (cont’d)Spatial Pyramid (cont d)Spatial Pyramid (cont d)
• ResultsResults– SVM classification
Scene recognition– Scene recognition
[Lazebnik 2006]]
65.2% for [Fei-Fei 2005]
![Page 29: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/29.jpg)
Spatial Pyramid (cont’d)Spatial Pyramid (cont’d)
[Lazebnik 2006]
![Page 30: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/30.jpg)
Spatial Pyramid (cont’d)Spatial Pyramid (cont’d)Spatial Pyramid (cont d)Spatial Pyramid (cont d)
– Object recognitionObject recognition
[Lazebnik 2006]
![Page 31: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/31.jpg)
Spatial Pyramid (cont’d)Spatial Pyramid (cont’d)Spatial Pyramid (cont d)Spatial Pyramid (cont d)
• StrengthsStrengths– Reasonable dimensionality
“Locally orderless”– Locally orderless – Dense representation
“Robust to failures at individual levels”– “Robust to failures at individual levels”• Weaknesses
– No invariability to composition of image – Not robust to clutter
![Page 32: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/32.jpg)
Scene CompletionScene Completion http://graphics.cs.cmu.edu/projects/scene-completion/
[Hays 2007]
…
Input image Scene Descriptor Image Collection
…
200 matches20 completionsContext matching
+ blendingHays and Efros, SIGGRAPH 2007
![Page 33: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/33.jpg)
[Oliva 2001]
![Page 34: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/34.jpg)
Topic Models [FeiTopic Models [Fei--Fei 2005]Fei 2005]Topic Models [FeiTopic Models [Fei Fei 2005]Fei 2005]
• Bayesian hierarchical modelBayesian hierarchical model• Intermediate representations
B f f t• Bag-of-features– 4 ways to extract regions– 2 types of features
![Page 35: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/35.jpg)
Topic Models (cont’d)Topic Models (cont’d)Topic Models (cont d)Topic Models (cont d)
[Fei-Fei 2005]
![Page 36: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/36.jpg)
Hierarchical Bayesian text modelsHierarchical Bayesian text models[Fei-Fei 2005]
“beach”
Latent Dirichlet Allocation (LDA)
wN
c zπN
D
Fei-Fei et al. ICCV 2005
![Page 37: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/37.jpg)
Topic Models (cont’d)Topic Models (cont’d)Topic Models (cont d)Topic Models (cont d)• η – distribution of
l l b lclass labels• θ – parameter
(estimated by EM)• c – class label• π – distribution of
themes for image• z – theme • x – patchx patch• β – parameter
(estimated by EM)
[Fei-Fei 2005]
![Page 38: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/38.jpg)
Topic Models (cont’d)Topic Models (cont’d)Topic Models (cont d)Topic Models (cont d)
• CodebookCodebook– 174 codewords
[Fei-Fei 2005][Fei-Fei 2005]
![Page 39: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/39.jpg)
Topic Models (cont’d)Topic Models (cont’d)
[Fei-Fei 2005]
![Page 40: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/40.jpg)
TopicTopicTopic Topic Models Models (cont’d)(cont’d)(cont d)(cont d)
• Results
[Fei-Fei 2005]
![Page 41: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/41.jpg)
Topic Models (cont’d)Topic Models (cont’d)Topic Models (cont d)Topic Models (cont d)
• StrengthsStrengths – Unsupervised
Invariant to composition– Invariant to composition• Weaknesses
– No geometry– Matches of themes to categories– No correspondence to semantic categories
![Page 42: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/42.jpg)
ComparisonComparisonComparisonComparison
• Global vs localGlobal vs. local– Spatial Envelope, Spatial Pyramid
Topic Models– Topic Models• Viewpoint / location biases vs. invariability
S– Spatial Pyramid – Topic Models, Spatial Envelope
![Page 43: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/43.jpg)
Comparison (cont’d)Comparison (cont’d)Comparison (cont d)Comparison (cont d)
• Intermediate representationsIntermediate representations– Spatial Envelope, Topic Models
Supervision vs no supervision• Supervision vs. no supervision– Spatial Envelope
S– Topic Models, Spatial Pyramid• Object recognition?
![Page 44: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/44.jpg)
DiscussionDiscussionDiscussionDiscussion
• Object recognition vs scene recognitionObject recognition vs. scene recognition– Global approaches
• Spatial Pyramid scenes vs objects results• Spatial Pyramid, scenes vs. objects results– Bag-of-features
• Use of scene recognition• Use of scene recognition• Ambiguous scenes• Human recognition of scenes
– Importance
![Page 45: Adriana pres scenes.ppt - Department of Computer … [Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories](https://reader031.vdocuments.us/reader031/viewer/2022022014/5b44a5437f8b9a2d328c15ed/html5/thumbnails/45.jpg)
ReferencesReferencesReferencesReferences[Fei-Fei 2005] L. Fei-Fei and P. Perona. A Bayesian
Hi hi l M d l f L i N t l SHierarchical Model for Learning Natural Scene Categories. CVPR 2005.
[Grauman 2005] K. Grauman and T. Darrell. The Pyramid M t h K l Di i i ti Cl ifi ti ith S t fMatch Kernel: Discriminative Classification with Sets of Image Features. ICCV 2005.
[Hays 2007] J. Hays and A.A. Efros. Scene completion using millions of photographs SIGGRAPH 2007using millions of photographs. SIGGRAPH 2007.
[Lazebnik 2006] S. Lazebnik, C. Schmid, and J. Ponce. Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories CVPR 2006Recognizing Natural Scene Categories. CVPR 2006.
[Oliva 2001] A. Oliva and A. Torralba. Modeling the Shape of the Scene: a Holistic Representation of the Spatial Envelope IJCV 2001Envelope. IJCV 2001.