it’s written all over your face: scalable facial coding by jason sosa of imrsv, inc. - presented...
TRANSCRIPT
![Page 1: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/1.jpg)
RecognitionDetectionTrackingCodingFACE TECH
[email protected] @jason_sosa
Privacy Future Hybrid Reality
![Page 2: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/2.jpg)
![Page 3: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/3.jpg)
“...fiendish Kodakers lying in
wait.”– New York Times
(1890)
![Page 4: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/4.jpg)
“Any sufficiently advanced technology is indistinguishable from magic.” – Arthur C. Clarke
![Page 5: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/5.jpg)
How does it work?
Magic!Tracking
Pose Estimation
Feature Point Detection
Recognition
Detection
Eye Tracking
Classification
![Page 6: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/6.jpg)
![Page 7: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/7.jpg)
1. Find Face
2. Follow Face
3. Understand Face
4. Identify Face
Eyes/nose/mouth
Track Location
Emotions, Gender/Age
Unique ID
![Page 8: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/8.jpg)
1.2 Billion cameras
(growing to 2.2B by 2017 with more coming...)
OOH Signage
Retail Analytics
End Caps
Market Research
Kiosks
Static Displays
Queue Efficiency
Vending
Doorway Entrance
Smart Phones
Tablets
Gaming Interactions
App Analytics
Adaptive Advertising
Photography
Social
Video
POS
SmartTV
Image Tagging
Interactive Toys
Wearable Computers
Physical World Digital World
Waiting in Lines
Automotive Innovation
CPU and sensorperformance increasing
Camera sensor costs rapidly decreasing
![Page 9: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/9.jpg)
![Page 10: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/10.jpg)
![Page 11: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/11.jpg)
![Page 12: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/12.jpg)
What can Cara do?
Adaptive Content
Real World Analytics
Real time analytics: gender, age and attention time using a standard
webcam.
Adapt content to audiences in real time.
Measure end caps, wait lines, doorway entrances, elevators and cash registers.
![Page 13: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/13.jpg)
![Page 14: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/14.jpg)
4.4%Unknown
2.6%Child 0.8%
Senior
web cam
PepsiCo case study
56.7%Young Adult
35.5%Adult
![Page 15: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/15.jpg)
• NO images/videos saved or recorded
• NO personal information collected• Securely encrypted data
Privacy by design
“Cara, is a major step forward for individual privacy...Steps that Cara takes such as not collecting any personal information, and not storing, transferring or recorded any images are key to ensuring privacy concerns are addressed...”
- Jules Polonetsky, Director and co-chair of the Future of Privacy Forum
![Page 16: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/16.jpg)
Where are we going?
50 Billion connected devices
by 2020
70 Million wearables by 2017
1 Billion connected vehicles by 2020
Internet of Everything
2.2B camera connected devices by
2017
Hybrid Reality
![Page 17: It’s Written All Over Your Face: Scalable Facial Coding by Jason Sosa of IMRSV, Inc. - Presented at the Insight Innovation eXchange North America 2013](https://reader035.vdocuments.us/reader035/viewer/2022081602/554cd65ab4c905cc488b4b4e/html5/thumbnails/17.jpg)