biometrics how do i know who you...
TRANSCRIPT
Biometrics How Do I know Who You Are?
How Do I know Who You Are
Anil K. Jain
Michigan State University
http://biometrics.cse.msu.edu
October 29, 2014
1
Outline
2
• Why biometrics?
• What is biometrics?
• Automatic biometric recognition
• Research opportunities
• Where is biometrics heading?
Bank ATM
Input to ATM:
Card
PIN: 6-digit (4-digit in US)
3
Machine does not know who is inputting the card and PIN
Is This ATM Secure?
6-digit PIN
#1 000000
#2 111111
#3 112233
#4 123123
Most popular 6-digit PINs Stolen or duplicate ATM cards, CCTV
4 http://aq.cebnet.com.cn/2014/0916/295234.shtml
How to Make ATM More Secure?
Biometric ATM in Lanzhou
Finger Vein recognition
module
5
High security (Card, PIN and Finger Vein) or Convenience (finger vein only)
Credit Card Data Stolen, July 2014
• JP Morgan says data
belonging to 83M
customers was stolen
• 88% of stolen data
used within minutes
USA Today, October 3-5, 2014 6
Cash, Credit or Apple Pay?
Apple Pay, Oct 20, 2014 (your fingerprint is the password) USA Today, Oct. 21 2014
Mobile Payment
M-Pesa allows deposit, withdraw & transfer money with a mobile; $882M USD/month
Joseph Van Os/Getty Images World population is 7.3B; ~4.5B have mobiles
Security Threats • People can not be trusted based on ID documents
• INTERPOL has data on 40M lost/stolen travel documents
• Some of the 9/11 hijackers had multiple driver licenses
幽灵户口:江西神秘中介叫卖幽灵户口 假身份证或涉诈骗犯罪 http://stock.591hx.com 2014年01月24日 10:36:06 新京报
9
US VISIT (OBIM) Program, 2004
U.S. border security through fingerprint identification 10
What is Biometrics?
11 Recognize a person based on body traits, not ID card or PIN
Biometric Traits
12
Biometrics is Not New!
13
Friction Ridge Patterns
Cummins and Midlo, Finger Prints, Palms and Soles, Dover, 1961 14
Early Days of Fingerprints
Fingerprint on a fragment of Palestinian lamp (400-500 C.E.)
15
A thumb print on a Chinese clay seal (300 B.C.E)
A Chinese deed of sale signed with a finger print (1839 C.E.)
Cummins and Midlo, Finger Prints, Palms and Soles, Dover, 1961
Fingerprint Types and Features
: core point : delta point
Arch Loop Whorl
Ridge ending Ridge bifurcation
Scotland Yard first used fingerprints for catching criminals in 1905; FBI in 1924 16
10 print
Automatic Fingerprint Identification System (AFIS)
• Find duplicates in database and catch criminals
• First AFIS (FBI, 1980): Fingerprints of 70M criminals & 34M civilians
17
Assumption 1: Uniqueness
Even identical twins have different fingerprints 18
Assumption 2: Persistence
1881, age 7 1890, age 17 1913, age 40
Herschel showed fingerprints can be matched even with a large time gap
W. J. Herschel, “The Origin of Finger-printing”, Oxford University Press, 1916 19
Fingerprint Recognition at Disney Parks
20
India’s Aadhar Program
• Provide a 12-digit unique ID number (UID) to all Indian residents
• De-duplication (one person, one UID) using 10 fingers & 2 iris
• ~700M residents have received a UID since 2009 21
Biometric Systems in China
Face & fingerprint verification at Lo Wu Face verification at Beijing Olympics
Face recognition at Beijing Airport Iris recognition for coal mine workers 22
Biometric Recognition System
Feature Extractor
Template Database
Verification
Enrollment
Matcher
(similarity score)
Yes: score > T
No: score < T
Preprocessor Preprocessor
T: threshold or system operating point
23
Verification: 1:1 matching (you claim who you are) Identification: 1:N matching (you do not claim your identity)
Reference fingerprint
How to Match Two Fingerprints?
Who made this impression?
24
Similarity = 0.9 Match!
Fingerprint Similarity Score Distributions Fr
equ
en
cy
Similarity score
T = 0.18
Score: 0.10 False Reject
Score: 0.39 True Accept
Fingerprint Similarity Score Distributions Fr
equ
en
cy
Similarity score
T = 0.18 Score: 0.05 True Reject
Score: 0.21 False Accept
Face Recognition
Probe Gallery
MATCH
Challenge: What is the best set of features and similarity measure?
27
How to Match Two Faces?
Face detection and normalization
Face detection
Face detection
Landmark detection
Landmark detection
Face normalization
Face normalization
Probe Gallery
28
How to Match Two Faces?
MLBP feature extraction and matching
0 2000 4000 6000 8000 100000
0.2
0.4
0.6
0.8
1
Feature dimensionality0 2000 4000 6000 8000 10000
0
0.2
0.4
0.6
0.8
1
Feature dimensionality
Similarity = 0.6 Match!
29
Score: 0.50 False Reject
Score: 0.92 True Accept
Face Similarity Score Distributions
T = 0.52
30
Face Similarity Score Distributions
T = 0.52 Score: 0.05 True Reject
Score: 0.55 False Accept 31
State of the Art Performance
Users
Imag
ing
Co
nd
itio
ns
Cooperative Co
nst
rain
ed
100% TAR @ FAR=0.1%
99.4% TAR @ FAR=0.01%
FVC2002 FRGC, Exp. 1
Un
con
stra
ined
Altered fingerprint
97% TAR @ FAR=0.1%
FERET’06
75% Rank-1 accuracy
Uncooperative
99% TAR @ FAR=1.0%
72% Rank-1 accuracy
NIST SD27 LFW
32
FVC2004 MBGC
92.2% TAR @ FAR=0.01%
MBGC
98% TAR @ FAR=0.1%
Research Opportunities
33
Intra-person Variability
Same woman arrested at different times
34
35
Inter-person Similarity
Identical twins Father and son
35
Latent (Partial) Fingerprint Matching
Latent fingerprint Segmented and enhanced latent fingerprint
Mated rolled fingerprint
Unconstrained Face Detection & Recognition
37 Not all faces can be detected by the best algorithm!
Face Recognition in Video
20M surveillance cameras in China (3M in Beijing & Shanghai) 38
Recognize Person of Interest
39
Boston marathon bombing, April 15, 2013 Suspects Photo in database
Soft Biometrics: Scars, Mark & Tattoos
http://wtvr.com/2012/05/04/pictures-investigators-seek-shirtless-heavily-tattooed-suspect/ 40
Tattoos to Distinguish Identical Twins
Haircuts help to avoid confusion among the four identical six-year-old twins
http://www.cbsnews.com/8301-503543_162-57508537-503543/chinese-mom-shaves-numbers-on-quadruplets-heads/
Does the matching accuracy decrease with time?
June 2001 January 2003 January 2005
August 2007 April 2010 July 2013
Longitudinal Study of Fingerprints
Capacity of a Biometric Trait
Can we recognize all the 1.3B faces in China?
Biometric Spoof Attacks
2D fingerprint image 3D virtual spoof
2D image of spoof 3D printed spoof 2D fingerprint image
Spoof Vs. Real Fingerprint
Where is Biometrics Heading? • Biometric recognition will be everywhere: on-line
payment, airports & train stations, network access,…..
• Recognition will be made not just based on body trait(s) but also on “what you are doing” (context)
• Challenges:
– Recognize persons in unconstrained conditions
– Prevent spoof attacks & secure user templates
46
Biometrics For Lifetime
Inked finger of an Afghan woman after voting in Bamiyan, Afghanistan
Fingerprint capture of a baby at a health clinic in Cotonou, Benin
Beyond Person Recognition
48