distinguish genuine and posed emotions using computer ... · second step: render 3d mesh into 2d...
TRANSCRIPT
![Page 1: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/1.jpg)
Distinguish Genuine and Posed Emotions using Computer Vision Deep Learning Approach
J I A L I N YA N G
U 5 8 9 4 1 0 0
C O M P 4 5 6 0
S U P E R V I S E D BY
D R . TO M G E D E O N ;
D R . Z A K I R H O S S A I N ;
M R . M O S H I U R FA R A Z I
![Page 2: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/2.jpg)
Outliine
§ Introduction§ Method§ Conclusion§ Reference
![Page 3: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/3.jpg)
Introduction
![Page 4: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/4.jpg)
Introduction – Our Goal
I can tell ya, This guy is fake his smiling.
Be careful of him!
![Page 5: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/5.jpg)
Some existing methods and theiraccuracy
![Page 6: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/6.jpg)
Our Method
3-Steps:
1. Generating 3D mesh from2D input image
2. Render the mesh and useemotion detection to decidethe potential of the emotion
3.Evaluate the accuracy of ourmethod.
![Page 7: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/7.jpg)
First Step:
2D Image to 3D Mesh
68 Dots captured
More dots will capture more details but increase the running speed.
![Page 8: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/8.jpg)
Second Step:
Render 3D mesh into 2D Image
Using Blender currently
Using Deep Learning network to distinguish the emotion possibilities.
30% Smile10% Angry5% Sad
Neural Network withpretrained model
![Page 9: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/9.jpg)
Third Step:
Evaluation of our method
See its accuracy compared to other models
![Page 10: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/10.jpg)
Conclusion
§ New distinguished method – Introduce the use of 3D mesh generating and rendering before applying the Neural network
§ The accuracy result relies on the accuracy of the 3D mesh generator
§ Expecting a higher accuracy compared to other deep learning methods
![Page 11: Distinguish Genuine and Posed Emotions using Computer ... · Second Step: Render 3D mesh into 2D Image Using Blender currently Using Deep Learning network to distinguish the emotion](https://reader036.vdocuments.us/reader036/viewer/2022071022/5fd6a5b993f3f80fb0660b7c/html5/thumbnails/11.jpg)
ReferenceKim, Y., & Huynh, X. (2017). Discrimination Between Genuine Versus Fake Emotion Using Long-Short Term Memory with Parametric Bias and Facial Landmarks. 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), 3065-3072.
Jianzhu.Guo, 3DFFA, (2019), GitHub repository, https://github.com/cleardusk/3DDFA