see the view (stv) project · 2020-03-16 · see the view (stv) project environmental perception...
TRANSCRIPT
![Page 1: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/1.jpg)
Proprietary & Confidential | 1Proprietary & Confidential | 1
See the View (STV) Project
Environmental Perception
for
Safer and Reliable Autonomous DrivingArie [email protected]
Co-funded by the Horizon 2020program of the European Union
![Page 2: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/2.jpg)
What we do
Driving Decisions
Perception & Fusion
Sensors
Vehicle Perception
based on raw data fusion with upsampling and AI
Co-funded by the Horizon 2020program of the European Union
![Page 3: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/3.jpg)
Proprietary & Confidential | 3
Fusion & Perception
PerceptionEngine
Raw Data Fusion & Detection
⁺ Raw data fusion not objects
⁺ 3D RGBd model
➢Higher detection rates
➢Less false alarms
➢Overcome faults
Camera
. . .
RADAR
LiDAR
Co-funded by the Horizon 2020program of the European Union
![Page 4: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/4.jpg)
Proprietary & Confidential | 4
Fusion & Detection Framework
⁺ Higher Quality (accuracy and reliability)
⁺ Lower system cost (Sensors, BUS, processing, energy)
Sensors Raw Data
⁺ Camera
⁺ Lidar
⁺ Radar
Environmental Model
Co-funded by the Horizon 2020program of the European Union
![Page 5: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/5.jpg)
Proprietary & Confidential | 5
Detection, Classification, Segmentation
Obstacle detection
Road Detection
Object BB detection
Semantic Segment.
Objects data-base
Objects
Multi-frame Object Tracking
Environmental Model
HD RGBd3D Model
Software Framework
Fusion & Perception
Ego-motion
Up-sampling
Calibrate
&
Unroll
&
Match
E-MI/F
Driving Module
Raw data Fusion
Camera
. . .
RADAR
LiDAR
Co-funded by the Horizon 2020program of the European Union
![Page 6: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/6.jpg)
LIDAR 64 - Before Up-sampling
Co-funded by the Horizon 2020program of the European Union
![Page 7: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/7.jpg)
LIDAR 64 - After Up-sampling
3D High Resolution at Low Cost
Co-funded by the Horizon 2020program of the European Union
![Page 8: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/8.jpg)
Proprietary & Confidential | 8
Accurate SLAM – Ego-Motion
Co-funded by the Horizon 2020program of the European Union
![Page 9: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/9.jpg)
Proprietary & Confidential | 10
Environmental Model
Pedestrian
Vehicles
Free Space
Free Space
Red – Objects
Bird Eye View Detection by Non- DNN
Detection by Classification (DNN)
Blue Ground
Co-funded by the Horizon 2020program of the European Union
![Page 10: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/10.jpg)
Proprietary & Confidential | 11
Peacocks crossing the street Detecting the unexpected – Non-DNN
![Page 11: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/11.jpg)
Proprietary & Confidential | 12
Urban Driving in Tel-Aviv
![Page 12: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/12.jpg)
Proprietary & Confidential | 13
STV Project Objectives
Co-funded by the Horizon 2020program of the European Union
![Page 13: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/13.jpg)
Proprietary & Confidential | 14
STV expected and planned performances
Co-funded by the Horizon 2020program of the European Union
![Page 14: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/14.jpg)
Proprietary & Confidential | 15
STV Project plan
Co-funded by the Horizon 2020program of the European Union
![Page 15: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/15.jpg)
Proprietary & Confidential | 16
STV Schedule and Gantt Chart
Co-funded by the Horizon 2020program of the European Union
![Page 16: See the View (STV) Project · 2020-03-16 · See the View (STV) Project Environmental Perception for Safer and Reliable Autonomous Driving Arie Gavriely Arie.Gavriely@vayavision.com](https://reader034.vdocuments.us/reader034/viewer/2022050509/5f99dda5e8d3002c98196004/html5/thumbnails/16.jpg)
Proprietary & Confidential | 17Proprietary & Confidential | 17
Benefits
⁺ Raw Data Fusion ⁺ The optimal method for reliable detection
⁺ Up-Sampling ⁺ Increasing LiDAR/RADAR low resolution
with smart algorithms
⁺ Detection and Classification ⁺ Most accurate and reliable detection
Better performance with current sensor set and
Roadmap for low cost system
Co-funded by the Horizon 2020program of the European Union