interviewing and deception detection techniques for rapid screening and credibility assessment
DESCRIPTION
Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment. Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon. Agenda. Introduction Project Phases Project Plan Year One: Unique Datasets Year One: Sensors and Tools Year One: Tasks - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/1.jpg)
Interviewing and Deception Detection Techniques for Rapid Screening and
Credibility Assessment
Dr. Jay F. Nunamaker, Jr.Dr. Judee K. Burgoon
![Page 2: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/2.jpg)
2
Agenda
• Introduction• Project Phases• Project Plan
– Year One: Unique Datasets– Year One: Sensors and Tools– Year One: Tasks
1. Analysis Psycho-Physiological Datasets 2. Lexical Analysis3. Interoperable Video Database 4. Collaborative Credibility Assessment Tools
• Conclusion
![Page 3: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/3.jpg)
Introduction
• Identify verbal/non-verbal behaviors and physiological cues that indicate deception and hostile intentions in rapid screening environments
• Experimental research to evaluate and develop automated deception detection technology
• Develop questioning and information elicitation strategies for border screeners
3
![Page 4: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/4.jpg)
Project Phases
• Experimentation and analysis of credibility assessment tools– Test new deception detection technology which incorporate verbal/non-
verbal behavior and physiological measures– Prototype automated systems and enabling technologies for detecting
deception– Replicate knowledge learned in experiments in the field
• Analysis of interviewing techniques in screening scenarios – Techniques for information elicitation– Behavioral analysis and questioning strategies
• Screening and border specific analysis of detection methods– Unobtrusive methods for behavior monitoring and deception detection– Interview and screening techniques
4
![Page 5: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/5.jpg)
Project Plan
Phase Schedule (year)
1 2 3 4 5 6
(1) Experimentation and analysis of credibility assessment tools
(2) Analysis of interviewing techniques in screening scenarios
(3) Screening and border specific analysis of detection methods
5
![Page 6: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/6.jpg)
Project Plan – Year 1Unique Datasets
• Datasets for original analysis:– Cultural Benchmarks
• 220 international participants• Professionally interviewed (25 questions)• Lie or truth instructions
– Mock Crime• 134 participants• Realistic Mock theft scenario
• New Proposed Experiments
6
![Page 7: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/7.jpg)
7
Project Plan – Year 1Mock Crime: Experiment Example
Stage 1: Subject arrival at separate building
Stage 2: Subject receives instructions by recording
Stage 3: Subject arrives at secretary’s office to steal ring
Stage 4: Subject completes credibility interview about involvement in theft
![Page 8: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/8.jpg)
Project Plan – Year 1Sensors and Tools
LDV THERMAL BLINK
EYE-TRACKING
PUPILOMETRY
KINESIC
Equipment supplied by:
![Page 9: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/9.jpg)
Project Plan – Year 1 Task 1: Analysis Psycho-Physiological Datasets
• Phase 1: LDV Data Analysis (Year 1)– Unintentionally leaked psycho-physiological cues may be indicative
of deceptive behavior – “Cultural Benchmarks” experiment captured Pulse and Respiration
data via LDV– Determine if the LDV can provide cues that are indicative of
deception• Phase 2: Data from multi-sensors (Year 2)
– Cultural Benchmarks Experiment – sensor data analyzed individually – not looked at collectively• Pulse Respiration, Kinesics (Blob, ASM, Gestures, Blinking,
Pose), and Pupilometry• Phase 3: Data-fusion techniques (Year 2)
– How do we fuse data from distinct sources?– Do fusion techniques provide greater accuracy in detecting
deception?
![Page 10: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/10.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1
Perform analysis of data from LDV collected during previous deception experiment. Determine if any psycho-physiological cues emerge that indicate deceptive behavior. Deliverable is the psycho-physiological cues provided by LDV indicative of deception.
6 months
(2) Phase 2
Gather additional experimental data collected from various sensors during deception detection experiment. Format and prepare for processing. Deliverable is a formatted data set ready for analysis.
6 months
(3) Phase 3
Explore methods to fuse data into one robust algorithm. Conduct statistical analysis to determine if collectively the combined sensor output is a greater predictor of deceptive behavior.
6 months
*Year one deliverables in green
![Page 11: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/11.jpg)
Project Plan – Year 1 Task 2: Lexical Analysis
• “words whose job it is to make things more or less fuzzy” (Lakoff, 1972)
• e.g. perhaps, might, maybe, approximately• Communicates speaker’s degree of
confidence (Hyland, 1998; Coates, 1987)
• Reduces strength of a statement (Zucker & Zucker, 1986)
• Expresses tentativeness and probability• Theoretically linked to deception use
![Page 12: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/12.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1 Prepare transcriptions of cultural benchmarks interviews for analysis 1 month
(2) Phase 2 Refine hedging dictionaries and lexical bundle software 1 month
(3) Phase 2bParse text, generate features, run classification algorithms, run statistical analyses
2 months
(4) Phase 3 Write results and discuss implications for rapid screening, articulate future investigations
2 months
*Year one deliverables in green
![Page 13: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/13.jpg)
Project Plan – Year 1 Task 3: Interoperable Video Database
Currently have many large, disparate data sources. Challenges in managing large and diverse data sets include:
• Integrating the datasets efficiently• Querying integrated data sets intelligently
• Example: Retrieve all data associated w/specific gesture• Capturing tacit information• Determining the elementary/composite data elements• Creating semantic interoperability across the datasets
In order to begin addressing these challenges, we need to begin to create a framework which will help us understand the datasets and how to manage them holistically.
Mock Crime Interviews
Cultural Benchmarks Interviews
Retrieve all data associated with shrugs
![Page 14: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/14.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1
Initial Data Framework and Recommendations – an initial data framework that integrates video datasets from two experiments. This framework will serve as discussion for the future data management directions.
6 month
(2) Phase 2Prototype Implementation –implement prototype to demonstrate solutions to various data challenges.
Through Year 6
*Year one deliverables in green
![Page 15: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/15.jpg)
Project Plan – Year 1 Task 4: Collaborative Credibility Assessment Tools
Problem: Individuals are not as accurate as machines in credibility assessment
Proposal: Use group collaboration to discover more cues to deception
First phase Deliverable: Determine feasibility of and requirements for collaboration tools for credibility assessment. Create prototype(s)
![Page 16: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/16.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1 Methodically identify and adapt most useful collaboration tools 3 month
(2) Phase 2 Design software 2 month
(3) Phase 2b Create initial prototype(s)* 1 month
*Year one deliverables in green
![Page 17: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment](https://reader035.vdocuments.us/reader035/viewer/2022062501/56816108550346895dd05049/html5/thumbnails/17.jpg)
Conclusion
• Identify verbal/non-verbal behaviors and physiological cues that indicate deception and hostile intentions in rapid screening environments
• Experimental research using unique datasets to evaluate and develop: – Automated deception detection technology– Experimental research to evaluate and develop automated
deception detection technology
• Four proposed tasks with deliverables in Year One