TextSession Overview: Strategy #1 of the CDMA's strategic plan is to promote AASHTO’s Core Data Principles. The seven principles are used to guide the public or private sector's use of transportation data. This session will highlight each one with a real-world example in use by State DOT's.
Moderator: Anita Vandervalk-Ostrander, ITERISPresenters: Michael Pipp, Montana DOT; Chris Hundt, Michigan DOT; Ryan Marlow, Alaska DOT & PF
Day 1 | October 5, 2021 11 – 11:55 AM ET AASHTO Core Data Principles in Action
TextTransportation Data Trends
• Cloud-Based Transportation Management Systems• Location of processing (edge versus cloud)• Data Platforms• Data Governance• Mobility as a Service (MaaS)• Drone Delivery or unmanned aerial vehicles (UAVs) • Predictive analytics• Artificial Intelligence/Machine Learning• As a Service• Video analytics• Commercial Vehicle – Vehicle to Everything (V2X) and 5G• Commercial Vehicle Data
Text
AASHTO’S 7 Data Principles
Principle 1 - VALUABLE: Data is an AssetData is a core business asset that has value and is managed accordingly
Example: Michael Pipp, Montana DOT
Principle 2 - AVAILABLE: Data is open, accessible, transparent and sharedAccess to data is critical to performing duties and functions, data must be open and usable for diverse applications and open to all.
Example: Michael Pipp, Montana DOT
TextAASHTO’S 7 Data Principles cont.
Principle 3 - RELIABLE: Data quality and extent is fit for a variety of applicationsData quality is acceptable and meets the needs for which it is intended.
Example: Chris Hundt, Michigan DOT
Principle 4 - AUTHORIZED: Data is secure and compliant with regulationsData is trustworthy and is safeguarded from unauthorized access, whether malicious, fraudulent or erroneous
Example: Ryan Marlow, Alaska DOT&PF
TextAASHTO’S 7 Data Principles cont.
Principle 5 - CLEAR: There is a common vocabulary and data definitionData dictionaries are developed and metadata established to maximize consistency and transparency of data across systems.
Example: Ryan Marlow, Alaska DOT&PF
Principle 6 - EFFICIENT: Data is not duplicatedData is collected once and used many times for many purposes.
Example: Ryan Marlow, Alaska DOT&PF
Principle 7 - ACCOUNTABLE: Decisions maximize the benefit of dataTimely, relevant, high-quality data are essential to maximizing the utility of data for decision making.
Example: Chris Hundt, Michigan DOT
Principles of Data # 1 - Valuable: Data is an Asset
BUT FIRST… WHAT DATA DO WE EVEN HAVE?
Building a Data Catalog: Part 1: Data Set Inventory
WHAT TO ASK: MS Forms survey with 32 to 48 questions around the 6 data interrogatives
WHO TO ASK: data stewards, data managers, program managers
PROCESS: 90+ interviews/virtual meetings over ~7 months
OUTCOME: 401 data sets (GIS Layers excluded)
Principles of Data # 1 - Valuable: Data is an AssetMDT DATA CATALOG – APEX ORACLE DATABASE
Data added/updated via import script and .csv source file
Principles of Data # 1 - Valuable: Data is an Asset
Web page form populated with JSON file export from System Catalog (APEX Oracle dB)
MDT DATA CATALOG – INTRANET
MDT File Share
Building a Data Catalog: Part 2: Governed Data Catalog
IBM Cloud Pak for Data – Watson Knowledge Catalog
Principles of Data # 1 - Valuable: Data is an Asset
Principles of Data # 2 - Available: Data is open, accessible, transparent & shared
People access & sharingAccess-controlled & governed Data Catalog
Principles of Data # 2 - Available: Data is open, accessible, transparent & shared
People access & sharingProject area for DQ assessment, data analytics, & dashboards
Principles of Data # 2 - Available: Data is open, accessible, transparent & shared
System-to-System Access & Sharing: MDT Services Broker (“iBroker”)
MDOT’s Traffic Monitoring Program
• Regularly count traffic at over 21,000 locations
• Data used for COVID monitoring is from over 100 continuous count stations
COVID-19 Timeline
• Jan 8, 2020 - 1st public alert issued in the US
• Jan 22, 2020 - 1st case reported in the US
• Mar 10 - 1st cast reported in Michigan
• Mar 9 – 20 – WFH movement gathers steam in MI
• Mar 24 - Stay Home, Stay Safe Order takes effect
• Apr 24 - Start of phased re-opening
MDOT’s Public Power BI Traffic Dashboard
Flexible Solution
• Site provides data by:• Day
• Week
• Month
• Year (2019 – 21)
• Region
• Data easily exported
Ensuring Data Reliability – Principle 3
• Are we getting good data from TDMS?• Automated and manual QC checks
• Is the data being used, displayed, and made available properly on our dashboard?• Manual QC checks
Automated Quality Control
• 34 automated QC checks prior to putting the data into our database• Annually review automated QC settings
• Adjusted settings in early days of Pandemic
• Critical QC Failures• Data withheld until manually reviewed
• Noncritical QC Failures• Data is allowed in and manually reviewed
Manual Quality Control
• Three manual QC checks• Two occur prior to loading
• Rarely result in changes
Accountable to Decision Makers – Principle 7
• Data directly requested by decision makers• Analytics designed to address questions early in pandemic
• Dashboard was modified as needs changed
Text
Ryan Marlow, CMSUAS Program Coordinator
Alaska Department of Transportation and Public Facilities