ai gone rogue: exterminating deep fakes before they cause ......ai gone rogue: exterminating deep...
TRANSCRIPT
![Page 1: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/1.jpg)
AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace
Vijay ThawareSymantec@021vj
Niranjan AgnihotriSymantec@agnihotrins
![Page 2: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/2.jpg)
Agenda:
● Deep Fakes: Should we trust what we see ?● Ingredients of a Deep Fake● Cutting poison with poison● Looking at Deep Fakes through biological microscope● Limitations ● How does the future look ?● Black Hat Sound Bytes
![Page 3: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/3.jpg)
Deep Fakes: Should we trust what we see ?
Image Source: https://cheezburger.com/7629944064
![Page 4: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/4.jpg)
Deep Fakes: The many faced evil
● Cyber propaganda● Fake news=Deep fake news● Trust issues● Disinformation campaigns● Emotional distress● Can become ubiquitous● Morality vs Legality
![Page 5: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/5.jpg)
What it takes to prepare a Deep Fake?
Image Source: [StartupStockPhotos] https://pixabay.com/en/children-win-success-video-game-593313/
![Page 6: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/6.jpg)
★ Autoencoders
Image Source: https://www.alanzucconi.com/2018/03/14/understanding-the-technology-behind-deepfakes
Ingredients of a Deep Fake
![Page 7: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/7.jpg)
How are deep fakes created?
Image Source: https://www.alanzucconi.com/2018/03/14/understanding-the-technology-behind-deepfakes Image Source: https://www.alanzucconi.com/2018/03/14/understanding-the-technology-behind-deepfakes
![Page 8: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/8.jpg)
Cutting poison with poison
★ Our Solution
★ Demo !
![Page 9: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/9.jpg)
Face Net Model [1]
(128,1) encoding
Triplet Loss
![Page 10: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/10.jpg)
![Page 11: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/11.jpg)
Results
![Page 12: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/12.jpg)
Scope for Improvement
o Face liveness detection
o Contextual intel mechanisms
o Texture investigation
o User interaction
Source: https://medium.com/swlh/anti-spoofing-mechanisms-in-face-recognition-based-on-dnn-586011ccc416
![Page 13: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/13.jpg)
Cutting poison with poison
★ Merits
○ Scalable○ Small, simple, fast○ Implementation
on social media
★ Limitations
○ Performs best only when deep fakes are produced by face swapping/tampering
○ Won’t work on videos created without face tampering
![Page 14: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/14.jpg)
Looking at Deep Fakes through biological microscope
★ Eye blinking :-
○ Mean blinking rate is 17 blinks/minute (rest)○ While during conversing it gets to 26 blinks/minute○ While reading it gets to 4.5 blinks/minute
Siwei Lyu et al “In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking”
![Page 15: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/15.jpg)
Looking at Deep Fakes through biological microscope
★ Key approach :
○ Extract the face region from the frames of the video
○ Use LRCN (Long Term Recurrent Convolutional Network) to detect eye blinks
Siwei Lyu et al “In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking”
★ Observation
○ Generally the actors in the deep fake videos are not seen blinking. If not this, their blinking patterns are weird.
![Page 16: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/16.jpg)
Limitations
○ Difficult but not impossible to create deep fakes with a
normal eye blink behavior with adequate data
○ Videos of a very small length (< min)
○ No front facing angle
○ Scaling up
○ No face tampering (deep fakes v2.0)
![Page 17: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/17.jpg)
How does the future look ?
Videos WITHOUT face tampering
![Page 18: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/18.jpg)
BuzzFeedVideo, Barrack Obama Jordan Peele
Videos WITHOUT face tampering
![Page 19: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/19.jpg)
Black Hat Sound Bytes
● Video watermarking● Think before you forward THAT video● Credibility of the source● Robust Laws
![Page 20: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/20.jpg)
?
![Page 21: AI Gone Rogue: Exterminating Deep Fakes Before They Cause ......AI Gone Rogue: Exterminating Deep Fakes Before They Cause Menace Vijay Thaware Symantec @021vj Niranjan Agnihotri Symantec](https://reader033.vdocuments.us/reader033/viewer/2022060508/5f23ccdebcb92807fb3216f9/html5/thumbnails/21.jpg)
Thank You !
Vijay ThawareSymantec@021vj
Niranjan AgnihotriSymantec@agnihotrins