advanced seminar in biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting...

29
Advanced Seminar in Biometrics Ulrich Scherhag, C. Rathgeb da/sec - Biometrics and Internet Security Research Group, Hochschule Darmstadt Darmstadt, 17.10.2017 Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 1/28

Upload: others

Post on 15-Mar-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Advanced Seminar in Biometrics

Ulrich Scherhag, C. Rathgeb

da/sec - Biometrics and Internet Security Research Group, Hochschule Darmstadt

Darmstadt, 17.10.2017

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 1/28

Page 2: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Personalia/Formalia

Morphing Attacks

Topics

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 2/28

Page 3: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Personalia/Formalia

Personalia/Formalia

Morphing Attacks

Topics

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 3/28

Page 4: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Personalia/Formalia

Contact and Website

◮ Supervisors: Christian Rathgeb and Ulrich Scherhag

◮ Rooms: D19 2.01/2.02

◮ Email addresses:[email protected]

[email protected]

◮ URL of seminar:https://dasec.h-da.de/teaching/

advanced-seminar-rathgeb-scherhag-ws17/

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 4/28

Page 5: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Personalia/Formalia

Procedure

◮ Each group (up to two students) selects one of the presented topics

◮ Required materials will be handed over by the supervisors (tutorial):database, software, evaluation scripts etc.

◮ Progress reports have to be sent to both supervisors before thefollowing dates:1) 15. November2) 13. December3) 31. January

◮ Additional appointments shall be arranged individually and ondemand.

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 5/28

Page 6: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Personalia/Formalia

Procedure (cont’d)

◮ Each group has to prepare a (6-8 page) term paper (see website fortemplate)

◮ The term paper must be submitted by 1st March

◮ The final presentation will be 45 minutes per group + 15 minutesdiscussion of the results

◮ Suggested dates for the final presentations:6th March or 14th March

◮ A grade will be given based on the term paper and final presentation

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 6/28

Page 7: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Personalia/Formalia

Morphing Attacks

Topics

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 7/28

Page 8: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Enrolment and Verification

Enrolment

SensorFeature

Extraction

Database

Verification

Classify DecisionYesNo

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 8/28

Page 9: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Enrolment and Verification

Enrolment

SensorFeature

Extraction

Database

Verification

Classify DecisionYesNo

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 8/28

Page 10: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Attackpoints

source: ISO/IEC 30107-1

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 9/28

Page 11: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Normal ComparisonEnrolment Verification Score

→ 901

→ 1211

1calculated with Neurotec VeriFace (Spanish Border). Thresh. for FMR 0.1%: 37

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 10/28

Page 12: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Morphing Attacks

Subject 1 Morph Subj. 1+21 Subject 2

1generated with FantaMorph (www.fantamorph.com)

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 11/28

Page 13: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Morph ComparisonEnrolment Verification Score

→ 701

→ 591

1calculated with Neurotec Veriface. Threshold for FMR 0.1%: 37

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 12/28

Page 14: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Real World Attack Scenario

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 13/28

Page 15: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Morphing Attacks

Real World Attack Scenario II

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 14/28

Page 16: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Personalia/Formalia

Morphing Attacks

Topics

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 15/28

Page 17: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Overview

◮ Gender-based Morphing Attacks

◮ Morphing Attacks with Printing and Scanning

◮ Open-Source Soft-Biometric Extractors

◮ Open-Source Morphing Software

◮ Quality Estimation Framework for Facial Images

◮ Print-Scan resistant Watermarking (Survey)

◮ Face-based Soft-Biometrics (Survey)

◮ No-Reference Image Image Quality Metrics (Survey)

◮ Morphing Attacks across Image Scales

◮ Interpolation Methods for Morphing Attacks

◮ Enhancement (Post-processing) for morphed Images

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 16/28

Page 18: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Gender-based Morphing Attacks

What is the influence of printing and scanning to Morphing Attacks?Expected outcome:

◮ a database of facial images and morphed face images of the sameand different gender

◮ attack success evaluation reporting MMPMR1 and RMMR1 formorphs of the same and different gender

◮ a detailed report

1U. Scherhag, A. Nautsch, C. Rathgeb et. al Biometric systems under morphing attacks: Assessment of morphing

techniques and vulnerability reporting. In Int. Conf. of the Biometrics Special Interest Group (BIOSIG), pages 112, 2017.

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 17/28

Page 19: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Morphing Attacks with Printing and Scanning

What is the influence of printing and scanning to Morphing Attacks?

Applicant

Photo Printerdigital

Public Authority Office

Scanneranalog

Issuing Processdigital

Expected outcome:

◮ a printed and scanned database of facial images and morphed faceimages (> 2 different Printers, > 2 different scanners)

◮ attack success evaluation reporting MMPMR1 and RMMR2

◮ a detailed report2U. Scherhag, A. Nautsch, C. Rathgeb et. al Biometric systems under morphing attacks: Assessment of morphing

techniques and vulnerability reporting. In Int. Conf. of the Biometrics Special Interest Group (BIOSIG), pages 1–12, 2017.

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 18/28

Page 20: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Open-Source Soft-Biometric Extractors

Expected outcome:

◮ a survey on soft-biometrics

◮ a list of available open-source soft-biometric extractors withadvantages and disadvantages

◮ 2 working soft-biometric extractors

◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 19/28

Page 21: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Open-Source Morphing Software

Expected outcome:

◮ a survey on face image morphing

◮ a list of available open-source morphing software with advantagesand disadvantages

◮ 2 working examples for morphing software

◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 20/28

Page 22: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Quality Estimation Framework for Facial Images

Expected outcome:

◮ a survey on image quality

◮ a clear definition of face image quality

◮ a quality estimation framework for facial images

◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 21/28

Page 23: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Print-Scan resistant Watermarking (Survey)

Expected outcome:

◮ an extended survey on print-scan (print-cam) resistantWatermarking techniques

◮ a list of advantages and disadvantages of known methods

◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 22/28

Page 24: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Face-based Soft-Biometrics (Survey)

Expected outcome:◮ an extended survey on Soft-Biometrics◮ a list of available soft-biometrics, their advantages and

disadvantages◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 23/28

Page 25: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

No-Reference Image Quality Metrics (Survey)

BRISQUE = 21.0 BRISQUE = 29.1 BRISQUE = 50.0

Expected outcome:

◮ an extended survey on Image quality metrics

◮ a list of available image quality metrics, their advantages anddisadvantages

◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 24/28

Page 26: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Morphing Attacks across Image Scales

Expected outcome:

◮ a database of face images and morphed face images over differentscales

◮ an extended evaluation of the influence of image scales on morphingsuccess and morphing detection

◮ a detailed reportUlrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 25/28

Page 27: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Interpolation Methods for Morphing Attacks

Expected outcome:◮ adaptation of a morphing algorithm to employ different

interpolation methods◮ an extended evaluation of different interpolation methods regarding

attack success◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 26/28

Page 28: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Enhancement (Post-processing) for morphed Images

Contrast Sharpness

Expected outcome:◮ research on image enhancing techniques◮ a database of face images and morphed face images over

post-processing steps◮ an extended evaluation of the influence of post-processing on

morphing success and morphing detection◮ a detailed report

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 27/28

Page 29: Advanced Seminar in Biometrics - h_da · 2017. 10. 11. · attack success evaluation reporting MMPMR1 and RMMR2 a detailed report 2 U.Scherhag,A.Nautsch,C.Rathgebet. alBiometricsystemsundermorphingattacks:

Topics

Thank you for your attention!

... Questions?

Ulrich Scherhag WS 2017/2018 / Darmstadt, 17.10.2017 28/28