computer vision system design - mathworks · 4 computer vision for autonomous systems an...
TRANSCRIPT
![Page 1: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
Computer Vision System Design
![Page 2: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/2.jpg)
2
Computer Vision
![Page 3: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/3.jpg)
3
Computer Visionfor
Autonomous Systems
![Page 4: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/4.jpg)
4
Computer vision for autonomous systems
An increasingly important part of the pipeline
One of the key sensors in many applications is the camera
Other sensors also provide vision– Depth sensors– Infrared– LiDAR– RADAR
![Page 5: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/5.jpg)
5
More Sensors
Infrared Depth
![Page 6: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/6.jpg)
6
Multi sensor fusion
![Page 7: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/7.jpg)
7
Computer vision system design
Files
Databases
Sensors
ACCESS AND EXPLOREDATA
DEVELOP AND TESTALGORITHMS
Hardware-Accelerated Training
Parameter Tuning
Visualization
LABEL AND PREPROCESSDATA
Data Augmentation/ Transformation
Labeling Automation
Integrate Existing Research
INTEGRATE MODELS WITHSYSTEMS
Desktop Apps
Enterprise Scale Systems
Embedded Devices and Hardware
![Page 8: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/8.jpg)
8
Full System Design Example
![Page 9: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/9.jpg)
9
Original ImageOriginal Image
ROI detection
Pixel classification
![Page 10: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/10.jpg)
10
Semantic Segmentation
CamVid Dataset
1. Segmentation and Recognition Using Structure from Motion Point Clouds, ECCV 20082. Semantic Object Classes in Video: A High-Definition Ground Truth Database ,Pattern Recognition Letters
![Page 11: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/11.jpg)
11
Image Classification Network
Boat
Airplane
Other classes
![Page 12: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/12.jpg)
12
Semantic Segmentation Network
![Page 13: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/13.jpg)
13
Access and Explore Data
![Page 14: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/14.jpg)
14
Access image/video data
![Page 15: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/15.jpg)
15
Access pixel label data
![Page 16: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/16.jpg)
16
Label and Preprocess Data
![Page 17: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/17.jpg)
17
Using image labeling tools
![Page 18: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/18.jpg)
18
Develop and Test Algorithms
![Page 19: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/19.jpg)
19
Prepare the network for training
![Page 20: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/20.jpg)
20
Train and test the network
![Page 21: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/21.jpg)
21
Evaluate algorithm performance
![Page 22: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/22.jpg)
22
More evaluation
![Page 23: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/23.jpg)
23
Challenges we addressed
Accessing data
Labeling and preprocessing
Using previous research
Developing an algorithm
Evaluating the algorithm
What’s next?
![Page 24: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/24.jpg)
24
Computer vision system design
Files
Databases
Sensors
ACCESS AND EXPLOREDATA
DEVELOP AND TESTALGORITHMS
Hardware-Accelerated Training
Parameter Tuning
Visualization
LABEL AND PREPROCESSDATA
Data Augmentation/ Transformation
Labeling Automation
Integrate Existing Research
INTEGRATE MODELS WITHSYSTEMS
Desktop Apps
Enterprise Scale Systems
Embedded Devices and Hardware
![Page 25: Computer Vision System Design - MathWorks · 4 Computer vision for autonomous systems An increasingly important part of the pipeline One of the key sensors in many applications is](https://reader030.vdocuments.us/reader030/viewer/2022040410/5ece2cedee11c142a623dc25/html5/thumbnails/25.jpg)
25© 2015 The MathWorks, Inc.