visual analysis with artificial intelligence...existing techniques tubes, loops in road, radar,...
TRANSCRIPT
![Page 1: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/1.jpg)
Visual analysis with Artificial IntelligenceIn real-life applications
Dr. Ir. Egbert JaspersCEO, ViNotion
![Page 2: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/2.jpg)
Machine learning, deep learning Technology to learn an output from set of input data Understand voice, interpret images, reason, …
What is Artificial Intelligence?Human brains are mimicked
![Page 3: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/3.jpg)
Out market is traffic observation Pedestrians, crowds, bicycles, trucks, cars, vessels, …..
2007
Established
2014
People counting
20152017
New corporate identity
2011
Traffic & Mobility
Maritime
![Page 4: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/4.jpg)
Growing number of traffic participants Maintain safety Measure traffic: can we do this automatically?
Problem statementWhy do we need traffic analysis?
![Page 5: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/5.jpg)
Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification
Smart cameras Generic for all objects Easy maintenance (next to road) AI can learn (improve or new features)
Automatic Traffic AnalysisState-of-the-Art Technologies
![Page 6: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/6.jpg)
Objects are different from background
Naïve object recognitionState-of-the-Art in current security cameras
![Page 7: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/7.jpg)
Computer does not know what it sees…
Naïve object recognitionState-of-the-Art in current security cameras
![Page 8: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/8.jpg)
Visual ChallengesWhy is visual recognition difficult?
Light
Viewpoint
Occlusion
Intra-class
![Page 9: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/9.jpg)
Convolutional Neural Networks (CNNs)
Pre-deep learning
Deep learning
Human
Object Recognition: Deep LearningDeep learning works!
![Page 10: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/10.jpg)
Computing power back then…NASA Servers (1969) Nvidia Titan X (2015)
~1.000.000x more powerful
![Page 11: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/11.jpg)
Computing power now…
Nvidia TX1Compact10 Watt
Nvidia Titan XHigh performance250 Watt
![Page 12: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/12.jpg)
Deep learning in a box Embedded solutions Real-time object recognition Visual validation
Privacy by design No storage of images Anonymized statistics Never to relate to individual persons
ViSense: deep learning productizedIndustrial application of deep learning
![Page 13: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/13.jpg)
Standard products Principles: Modelling, Training & Validation
ViSense ProductsDeep learning productized
![Page 14: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/14.jpg)
ViSense ProductsDeep learning productized
• Public safety• Events• Retail
• Spatialplanning• Traffic control
system calibration
• Tolling• Traffic control
Integration
• Bridge & lockmonitoring
• Harborsafety
![Page 15: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/15.jpg)
CrowdDynamicsPedestrians and bicycles for business information or crowd control
Video intentionally blurred for privacy
![Page 16: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/16.jpg)
CrowdDynamicsPeople observation for safety and security
Video intentionally blurred for privacy
![Page 17: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/17.jpg)
UrbanDynamicsAnalyse traffic on a cross section for mobility improvement
Video intentionally blurred for privacy
Video intentionally blurred for privacy
![Page 18: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/18.jpg)
TrafficDynamicsHighways monitoring for emergency lanes, tunnels, tolling, etc.
Video intentionally blurred for privacy
Video intentionally blurred for privacy
![Page 19: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/19.jpg)
MaritimeDynamicsVessel analysis for bridge and waterlock control
Video intentionally blurred for privacy
![Page 20: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/20.jpg)
Crime involving vehicles Stolen, runaway, fraud (wrong license plate)
How to identify without/false plates? Goal: classify vehicle model with camera
Make and Model Recognition (MMR)Vehicle Recognition required for safety
VW Golf
![Page 21: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/21.jpg)
Dataset Statistics
Make and Model DatasetNon-uniform vehicle model distribution
587,371 Samples 1,504 Models Highly Non-uniform
![Page 22: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/22.jpg)
DemoNL Highway
![Page 23: Visual analysis with Artificial Intelligence...Existing techniques Tubes, loops in road, radar, Bluetooth/WiFi Subset of road users, expensive maintenance, limited classification Smart](https://reader036.vdocuments.us/reader036/viewer/2022071407/60fe9f6f6f39483d8216752b/html5/thumbnails/23.jpg)
Automated Traffic Analysis Deep learning in a box Embedded & low-power Privacy by design
Artificial Intelligence Very suitable for simple tasks Outperforminc human capabilities The furture is unprecedented (for good and for worse)
Conclusions