integration of roadside camera images and weather data for ... · systemml: declarative machine...
TRANSCRIPT
![Page 1: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/1.jpg)
Integration of roadside camera images and weather data for monitoring winter road surface conditions
Presented by: Juan CarrilloCandidate for MASc. in Computer SoftwareDepartment of Electrical & Computer EngineeringUniversity of Waterloo
Thanks to Prof. Mark Crowley - Machine Learning LabProf. Liping Fu and Guangyuan Pan - ITSS Lab
29/05/19
Source: thestar.com
![Page 2: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/2.jpg)
Agenda
1. Introduction
2. Datasets and area of study
3. Methodology and experiments
4. Conclusions
PAGE 2
![Page 3: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/3.jpg)
PAGE 3
Introduction1
![Page 4: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/4.jpg)
PAGE 4
Winter road maintenance: Safety and resource optimization
Ontario. 50% of the total highway maintenance budget is spent on winter maintenance operations. MTO
Toronto. Annual budget of $90 million to ensure that roads and sidewalks are clear and safe during the winter. theweathernetwork.com
Ottawa. The budget for winter operations in 2018 was $68.3 million, $2.3-million more than the previous year. OttawaCitizen.com
![Page 5: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/5.jpg)
PAGE 5
Winter road maintenance: Current approach
Road Weather Information Systems (RWIS)
Road patrolling visual inspection
Visual monitoring
Data-intensive processAutomation needed
Resource allocation
Limited geographic coverage
![Page 6: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/6.jpg)
PAGE 6
Winter road maintenance: Suggested approach
Add 6x more input data
(RWIS) + other MTO Cams + Env. Can Weather
Efficient decision making Better resource allocation, improved operations
Automated monitoring
Deep Learning for detecting road surface condition
Evaluate & improve
![Page 7: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/7.jpg)
PAGE 7
Datasets and area of study
2
![Page 8: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/8.jpg)
PAGE 8
Road Weather Information System (RWIS)
139 stationsin Ontario
Roadside cameraWeather sensorsEmbedded pavement sensors
Image source
Image source
Station NWR-06
![Page 9: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/9.jpg)
PAGE 9
Other MTO camera stations
439 camerasin Ontario
Roadside cameraWeather sensorsEmbedded pavement sensors
Image source
![Page 10: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/10.jpg)
PAGE 10
Environment Canada weather stations
99 stationsin Ontario
Roadside cameraWeather sensorsEmbedded pavement sensors
Image source
Image source
![Page 11: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/11.jpg)
PAGE 11
Area of study
Table 1. The three most densely inhabited ecoregions in Southern Ontario, StatCan 2016.
![Page 12: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/12.jpg)
PAGE 12
Methodology and experiments
3
![Page 13: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/13.jpg)
PAGE 13
Nearest neighbor NN analysis
![Page 14: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/14.jpg)
PAGE 14
L-Function analysis
![Page 15: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/15.jpg)
PAGE 15
Weather interpolation for MTO locationsSample of weather data
● 40 RWIS + 40 Env. Canada = 80 stations● Three weather variables● No-snow and snowy days● 480 observations in total
![Page 16: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/16.jpg)
PAGE 16
Weather interpolation for MTO locations
Interpolation methods
● Inverse distance weighted (IDW)● Radial Basis Function (RBF)● Ordinary Kriging (OK)
![Page 17: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/17.jpg)
SystemML: Declarative Machine Learning on Spark PAGE 17
Conclusions 4
![Page 18: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/18.jpg)
PAGE 18
Weather interpolation for MTO locations
For the three most populated ecoregions in Ontario
● By adding all other MTO cameras as image data sources to the RWIS system, six times more cameras are available.
● Adding weather stations from Environment Canada to the RWIS system increases the number of weather stations by 1.7x.
For weather interpolation in Ontario
● The best tradeoff between complexity and accuracy is offered by Radial Basis Functions (RBF).
![Page 19: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/19.jpg)
PAGE 19
Future work
Technical perspective
● Evaluate interoperability between different systems
● Include data from embedded pavement sensors
Policy and implementation perspective
● Design cooperation agreements
● Improve interaction with subcontractors
![Page 20: Integration of roadside camera images and weather data for ... · SystemML: Declarative Machine Learning on Spark PAGE 17 Conclusions 4. PAGE 18 Weather interpolation for MTO locations](https://reader034.vdocuments.us/reader034/viewer/2022042412/5f2c88587d2517397e5b08e4/html5/thumbnails/20.jpg)
PAGE 20
Questions