a short review on hmax model for biological object recognition · references serre, t., l. wolf and...
TRANSCRIPT
![Page 1: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/1.jpg)
A Short Review on HMAX Model for Biological ObjectRecognition
Amir Reza Saffari AzarInstitute for Theoretical Computer Science, Graz University of [email protected]
![Page 2: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/2.jpg)
Outline
Visual CortexHMAXModified HMAXNew HMAXExperimental ResultsDiscussionOur Motivation
![Page 3: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/3.jpg)
Visual Cortex Structure: Ventral Pathway
Wiskott, L. (2003)
![Page 4: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/4.jpg)
Properties
Layered StructureFeedback ConnectionsFeature HierarchyInvariance HierarchyFast RecognitionAttentionLearning
![Page 5: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/5.jpg)
Simplified Anatomy
Riesenhuber, M., and Poggio, T. (2000)
![Page 6: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/6.jpg)
HMAX
Serre, T., and Riesenhuber, M. (2004)
![Page 7: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/7.jpg)
HMAX
Serre, T., and Riesenhuber, M. (2004)
![Page 8: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/8.jpg)
HMAX
Serre, T., and Riesenhuber, M. (2004)
![Page 9: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/9.jpg)
HMAX
Serre, T., and Riesenhuber, M. (2004)
![Page 10: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/10.jpg)
HMAX
Serre, T., and Riesenhuber, M. (2004)
![Page 11: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/11.jpg)
HMAX
Serre, T., and Riesenhuber, M. (2004)
![Page 12: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/12.jpg)
Modified HMAX
Serre, T. et. al (2002)
![Page 13: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/13.jpg)
New HMAX
Serre, T. et. al (2005)
![Page 14: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/14.jpg)
Experimental Results
Serre, T. et. al (2005)
![Page 15: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/15.jpg)
Experimental Results
Serre, T. et. al (2005)
![Page 16: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/16.jpg)
Experimental Results
Serre, T. et. al (2005)
![Page 17: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/17.jpg)
Experimental Results
Serre, T. et. al (2005)
![Page 18: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/18.jpg)
Experimental Results
Serre, T. et. al (2005)
![Page 19: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/19.jpg)
Experimental Results
Serre, T. et. al (2005)
![Page 20: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/20.jpg)
Experimental Results
Serre, T. et. al (2004)
![Page 21: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/21.jpg)
Experimental Results
Serre, T. et. al (2004)
![Page 22: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/22.jpg)
Experimental Results
Serre, T. et. al (2004)
![Page 23: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/23.jpg)
Experimental Results
Serre, T. et. al (2005)
![Page 24: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/24.jpg)
Discussion
A promising biologically inspired model forobject recognition.Simple features.Good performance with low number of training samples.Operates well on different object categorieswithout extensive tunings.Universal dictionary of features.
![Page 25: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/25.jpg)
Our Motivations
Recurrent (feedback/lateral) connections.Sparse representation.Overcomplete representation.Online unsupervised learning.Image sequences: movies.
![Page 26: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/26.jpg)
References
Wiskott, L. (2003) How Does Our Visual System Achieve Shift and Size Invariance? Cognitive Sciences EPrint Archive (CogPrints) 3321, http://cogprints.org/3321/Riesenhuber, M., and Poggio, T. (2000) Models of Object Recognition. Nature Neuroscience 3 supp., 1199-1204.Serre, T., and Riesenhuber, M. (2004) Realistic Modeling of Simple and Complex Cell Tuning in the HMAX Model, and Implications for Invariant Object Recognition in Cortex, CBCL Paper #239/AI Memo #2004-004, Massachusetts Institute of Technology, Cambridge, MA.Serre, T., Riesenhuber, M., Louie, J., and Poggio, T. (2002) On the Role of Object-Specific Features for Real World Object Recognition in Biological Vision. In Biologically Motivated Computer Vision, Lee, S-W., H.H. Buelthoff and T. Poggio (eds.), Second IEEE International Workshop, BMCV 2002, Tuebingen, Germany, December 2002, 387-397.
![Page 27: A Short Review on HMAX Model for Biological Object Recognition · References Serre, T., L. Wolf and T. Poggio.(2005) Object Recognition with Features Inspired by Visual Cortex.In:](https://reader034.vdocuments.us/reader034/viewer/2022050114/5f4b10ce66e2824b875537a5/html5/thumbnails/27.jpg)
References
Serre, T., L. Wolf and T. Poggio. (2005) Object Recognition with Features Inspired by Visual Cortex. In: Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society Press, San Diego.Serre, T., L. Wolf and T. Poggio. (2004) A New Biologically Motivated Framework for Robust Object Recognition, CBCL Paper #243/AI Memo #2004-026, Massachusetts Institute of Technology, Cambridge, MA, November.