dynamic facrte recognition
DESCRIPTION
eytytyhhg gh hTRANSCRIPT
![Page 1: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/1.jpg)
Dynamic Scalable Distributed Face Recognition System Security Framework
by Konrad Rzeszutek
B.S. University of New Orleans, 1999
![Page 2: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/2.jpg)
Overview
Purpose History of face recognition Problems Solution
Apollo Components of Apollo Face recognition technology used Motion detection
Future work
![Page 3: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/3.jpg)
Applications of face recognition Surveillance Systems Biomedical Systems (eye-
replacement) Military (anti-terrorist groups) Security (logon authorization) Autonomous vehicle navigation … many more
![Page 4: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/4.jpg)
History Sir Francis Galton (1888) – Automatic
method of classification of French prisoners. Called it mechanical selector.
Late 1960s started. In 1980 research picked up dramatically. Two branches of face recognition:
Geometric-features Template matching
![Page 5: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/5.jpg)
Geometric - profile Profile features.
8-100 control points
Six control points using B-spline
U.S. INS uses this one extensively.
![Page 6: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/6.jpg)
Geometric - frontal Frontal features
8-16 features Various distance
from right and left eye to nose, nose to chin, eye to eye, etc.
Nose width, chin radii, eyebrow thickness, etc
![Page 7: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/7.jpg)
Template matching Face images are
represented as vectors in an array (each image is identified as k)
Computations are carried on the model arrays resulting in hash values.
The matching image hash value is compared against the template images’ hash values.
![Page 8: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/8.jpg)
Template matching, part 2 The distance from
the training images hash value determines the match. Euclidian distance
mostly used.
![Page 9: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/9.jpg)
Principal Component Analysis Turk and Pentland
– Eigenface. Most simplest –
uses the whole image face as a template.
Variations of this use infrared images.
![Page 10: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/10.jpg)
Template matching .. more Isodensity line maps (brightness of
image viewed as height of the mountain; isodensity lines corresponds to contour lines of equal altitude).
Neural network – eye and mouth regions feed into multi-layer perception engine that carries of the classification
.. Other are mostly various combinations of these two branches of face-recognition technologies.
![Page 11: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/11.jpg)
Problems Work done on a very selective set
of face images, mostly: In upright position Lighting and background controlled Either in frontal or profile view Have no occlusions, facial hair Most test cases are white males
![Page 12: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/12.jpg)
Solution A distributed system capable of
handling large load of images, analyze them in near-real time, provide support for future enhancements and be scalable to the load. Separates the functionality of a security
system in three modules: recognition, notification, and replay.
![Page 13: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/13.jpg)
Apollo
![Page 14: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/14.jpg)
Components Ares - the thin-client providing
camera feed. Hermes – the police officer directing
traffic Demeter – the storage for later replay
of camera-feed Nemesis – the face recognition engine Mors – the notification event server
![Page 15: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/15.jpg)
Ares Passes the real-time camera feed
through a motion-detection engine. Transmits the feed to Nemesis for
face-recognition and Demeter for storage.
Uses Jini/RMI to localize required components.
![Page 16: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/16.jpg)
Hermes Collects information about load of
each components. Is queried for its knowledge
whenever a system in a pool requires another component.
Scalable – many of these system (Hermes) can coexist and provide the load information.
![Page 17: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/17.jpg)
Demeter Stores camera-feed for later replay
and for storing the camera-feed on a archive media (WORM).
![Page 18: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/18.jpg)
Nemesis Face recognition module. Uses
Eigenfaces technique to match images in near-real time.
Can be extended to use more algorithms and check image using many techniques.
If match found, an event is sent to Mors.
![Page 19: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/19.jpg)
Mors Receives events
which notify about a possible face match.
Centralized pool where humans can visually check results and carry out proper procedures.
![Page 20: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/20.jpg)
Face recognition - Nemesis Eigenfaces – algorithm finds the
PCA of faces, or eigenvectors of the covariance matrix. “Each eigenvalue can be thought as
an amount which, when subtracted from each diagonal matrix, makes the matrix singular. … Eigenvectors are characteristics vectors of the matrix” (from “Digital Image Processing by Castleman)
![Page 21: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/21.jpg)
Eigenvalues and Eigenvectors We are looking for (eigenvectors) and
(eigenvalues) defined as:
C =
Where C is our covariance matrix of the normalized face-vector =[1 2 … M ]
TM
nTnn M
C
1M1
1
![Page 22: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/22.jpg)
Weights After the computation of eigenvalues and
eigenvetors, we use M’ most significant eigenfaces (where each eigenface is the linear combination of eigenvalues and the face-image) to form a face subspace.
From the face subspace we calculate the weights (where T=[1 2 .. M’]) :
k= kT k = 1,2, …, M’
![Page 23: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/23.jpg)
Matching We use the calculated weights to
determine if the image is recognized. Usually we use Euclidian distance.
![Page 24: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/24.jpg)
Motion Detection Motion detection is used on the client
side – Ares. It saves bandwidth and saves only
frames that have content. Algorithm uses two threshold functions:
The first is used to accommodate for possible artifacts introduced by the camera.
Second determines the if there is motion depending on the count of “clusters” of pixels that changed.
![Page 25: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/25.jpg)
Motion Detection, .. more Red is the “cluster” count.
![Page 26: Dynamic Facrte Recognition](https://reader033.vdocuments.us/reader033/viewer/2022051518/5695d5261a28ab9b02a43d4b/html5/thumbnails/26.jpg)
Future work Use more face recognition technologies so
each can complement each other. Expand framework to include other
recognition technologies: iris, speech, etc. Improve motion detection engine. Face operations – automatically removing
background. Generate from one face a multitude of other
faces with different alternations – bear (or lack of it), long hair, etc to expand possibly match.