![Page 1: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/1.jpg)
An Associate-Predict Model for Face
Recognition
CVPR 2011
Qi Yin1,3 Xiaoou Tang1,2 Jian Sun3
1. Department of Information EngineeringThe Chinese University of Hong Kong
2. Shenzhen Institutes of Advanced TechnologyChinese Academy of Sciences, China
3. Microsoft Research Asia
![Page 2: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/2.jpg)
Outline
Introduction
Identity Data Set and Face Representation
Associate-Predict model
Switching Mechanism
Experimental Results
![Page 3: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/3.jpg)
Introduction
Appearance-based for face recognition
Inevitable obstacle
Associate-Predict model
The studies of brain theories
![Page 4: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/4.jpg)
Introduction
![Page 5: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/5.jpg)
Identity Data Set and Face Representation
Identity data set
Face representation
![Page 6: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/6.jpg)
Identity data set
200 identities from the Multi-PIE data set
7 pose
4 illumination
![Page 7: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/7.jpg)
Face representation
Representation at the facial component level
12 facial components
Face F = (f1, f2, ..., f12) › fi for each component
![Page 8: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/8.jpg)
Associate-Predict model
Appearance-prediction model
Likelihood-prediction model
![Page 9: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/9.jpg)
![Page 10: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/10.jpg)
Appearance-predictionmodel
Two input faces
Setting : SA , SB › A and B are facial components
Select the specific face image setting is equal to SB
› component A’ from this image
![Page 11: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/11.jpg)
Appearance-predictionmodel
dA = |fA' − fB|› distance between the components
dB = |fB' − fA|
Final distance between A and B: 1/2 (dA + dB)
![Page 12: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/12.jpg)
Appearance-predictionmodel
Adaptive distance dp
αA and αB : weight
After the “appearance-prediction” on all 12 facial components , we can obtain a new composite face
![Page 13: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/13.jpg)
Likelihood-prediction model
Using classifier measure the likelihood of B belonging to A
Positive training samples› Input face › the K most alike generic identities
![Page 14: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/14.jpg)
![Page 15: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/15.jpg)
Switching Mechanism
Implement this switching mechanism› facial components : A and B › settings : SA = { PA , LA } and SB = { PB , LB }
Categorize the input pair into two classes› “comparable” › “not comparable” › based on the difference of SA and SB
![Page 16: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/16.jpg)
Switching Mechanism
Comparable class › {|PA − PB| < 3 } and {|LA − LB| < 3 }
Not comparable class › the rest situations
![Page 17: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/17.jpg)
Switching Mechanism
The final matching distance dsw
› da : the direct appearance matching › dp : the associate-predict model
![Page 18: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/18.jpg)
Experimental Results
Experiments on the Multi-PIE and LFW data sets
Basic comparisons
Results on benchmarks
![Page 19: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/19.jpg)
Basic comparisons
Holistic vs. Component
![Page 20: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/20.jpg)
Basic comparisons
Positive sample size› number of positive samples is 1 +
28*k › “1” is the input sample › K is the selected number of top-
alike associated identities
![Page 21: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/21.jpg)
Basic comparisons
K = 3 as the default parameter
![Page 22: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/22.jpg)
Basic comparisons
Switching mechanism› the switch model can effectively improve
the results on both benchmark
![Page 23: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/23.jpg)
Results on benchmarks
Multi-PIE benchmark
LFW benchmark
![Page 24: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/24.jpg)
Multi-PIE Benchmark
![Page 25: Introduction Identity Data Set and Face Representation Associate-Predict model Switching Mechanism Experimental Results](https://reader035.vdocuments.us/reader035/viewer/2022062322/5697bff41a28abf838cbd44a/html5/thumbnails/25.jpg)
LFW benchmark