i/ucrc program review xvii driving performance data verification process at the nads judith wightman...
TRANSCRIPT
![Page 1: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/1.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Driving Performance Data Verification Process at the NADS
Driving Performance Data Verification Process at the NADS
Judith WightmanGinger S. WatsonJudith WightmanGinger S. Watson
![Page 2: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/2.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Data Verification at NADSData Verification at NADS
• Overview
• Raw Data
• Data Reduction
• Verification Tools
• Issues, Concerns, Future Research
• Overview
• Raw Data
• Data Reduction
• Verification Tools
• Issues, Concerns, Future Research
![Page 3: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/3.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Data Verification at NADSData Verification at NADS
• The goal is to ensure that collected data are – Reliable
• Consistent or reproducible
– Valid• Meaningful and relevant
– Complete, yet concise
• The goal is to ensure that collected data are – Reliable
• Consistent or reproducible
– Valid• Meaningful and relevant
– Complete, yet concise
![Page 4: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/4.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Raw DataRaw Data
• Master list of up to 400 internal variables available on NADS
• Subset chosen based on goals of experiment– Binary collected in the data acquisition system (DAQ)– Various frequencies available per variable (up to 240 Hz)– Data can be converted to other formats and used in
various ways• MATLAB• ASCII• Excel• ISAT (Interactive Scenario Authoring Tool; for playback)• Reduced by coded algorithms
• Master list of up to 400 internal variables available on NADS
• Subset chosen based on goals of experiment– Binary collected in the data acquisition system (DAQ)– Various frequencies available per variable (up to 240 Hz)– Data can be converted to other formats and used in
various ways• MATLAB• ASCII• Excel• ISAT (Interactive Scenario Authoring Tool; for playback)• Reduced by coded algorithms
![Page 5: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/5.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Data ReductionData Reduction
• The process of transforming raw data into meaningful summary variables (called “reduced data”) that address experimental hypotheses
• Components– Identifying and defining summary variables of interest– Filtering the data– Applying various algorithms (automated or human
processed) to obtain the desired measures– Verifying that reduced data are valid (meaningful) and
reliable (consistent)
• The process of transforming raw data into meaningful summary variables (called “reduced data”) that address experimental hypotheses
• Components– Identifying and defining summary variables of interest– Filtering the data– Applying various algorithms (automated or human
processed) to obtain the desired measures– Verifying that reduced data are valid (meaningful) and
reliable (consistent)
![Page 6: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/6.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Data Reduction MethodsData Reduction Methods
• Automated code– Used to transform many data points into a
concise measure such as reaction time– Examples
• Reaction time to 10% release in accelerator pedal from point of incurring vehicle creation
• Minimum time to collision with incurring vehicle from point of incurring vehicle creation
• Automated code– Used to transform many data points into a
concise measure such as reaction time– Examples
• Reaction time to 10% release in accelerator pedal from point of incurring vehicle creation
• Minimum time to collision with incurring vehicle from point of incurring vehicle creation
![Page 7: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/7.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Data Reduction MethodsData Reduction Methods
• Human coding– Used when video analysis
or decomposition of non-driving behavior is needed, or when more efficient than automated coding
– Examples• Determination of number
of seconds taken to dial a wireless phone
• Loss of control in ESC studies (90 degrees non-zero yaw rate)
• Human coding– Used when video analysis
or decomposition of non-driving behavior is needed, or when more efficient than automated coding
– Examples• Determination of number
of seconds taken to dial a wireless phone
• Loss of control in ESC studies (90 degrees non-zero yaw rate)
![Page 8: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/8.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Verification ToolsVerification Tools
• ISAT– Displays top-down view of logical database and
scenario saved in raw data stream– Allows for review of participant drives and
examination of various reduced measures– Examples
• Verification of reaction time• Verification of accelerator release
• ISAT– Displays top-down view of logical database and
scenario saved in raw data stream– Allows for review of participant drives and
examination of various reduced measures– Examples
• Verification of reaction time• Verification of accelerator release
![Page 9: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/9.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Video ExampleVideo Example
![Page 10: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/10.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
ISAT Playback: Incurring Vehicle CreationISAT Playback: Incurring Vehicle Creation
![Page 11: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/11.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
ISAT Playback: Accelerator ReleaseISAT Playback: Accelerator Release
![Page 12: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/12.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
ISAT Playback: Brake OnsetISAT Playback: Brake Onset
![Page 13: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/13.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
ISAT Playback: End of EventISAT Playback: End of Event
![Page 14: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/14.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Verification ToolsVerification Tools
• SAS/Excel– Used to calculate measures of central tendency
for group or treatment, plot, or statistically analyze measures
– Examples• Velocity variance as calculated in SAS/Excel
equivalent to the reduced variable velocity instability in certain situations
• Excel used for calculating length of various parameters of wireless call data (e.g., dial/answer, connect, converse, disconnect)
• SAS/Excel– Used to calculate measures of central tendency
for group or treatment, plot, or statistically analyze measures
– Examples• Velocity variance as calculated in SAS/Excel
equivalent to the reduced variable velocity instability in certain situations
• Excel used for calculating length of various parameters of wireless call data (e.g., dial/answer, connect, converse, disconnect)
![Page 15: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/15.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Verification ToolsVerification Tools
• MATLAB– Used to plot performance over time– Example
• Sanity checks on phase (continuous measure of the delay in the participant’s reaction time to changes in lead vehicle’s speed)
• MATLAB– Used to plot performance over time– Example
• Sanity checks on phase (continuous measure of the delay in the participant’s reaction time to changes in lead vehicle’s speed)
![Page 16: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/16.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
MATLAB ExamplesMATLAB Examples
![Page 17: I/UCRC Program Review XVII Driving Performance Data Verification Process at the NADS Judith Wightman Ginger S. Watson Judith Wightman Ginger S. Watson](https://reader036.vdocuments.us/reader036/viewer/2022062515/56649cb95503460f9497f9bc/html5/thumbnails/17.jpg)
I/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVIII/UCRC Program Review XVII
Issues, Concerns, Future ResearchIssues, Concerns, Future Research
• Missing Data
• Generalizability
• Questions
• Missing Data
• Generalizability
• Questions