design your autonomous vehicle applications with nvidia...
TRANSCRIPT
Design your autonomous vehicle applications withNVIDIA DriveWorks components on RTMaps
Nicolas du LacCEO, Intempora
SAN JOSE MAY 8-11, 2017
Brief introduction about Intempora
Intempora
• Software editor company
• Created in 2000 - Over 15 years experience in ADAS/A.D. and embedded computing
• Over 15 years of experience
• Strong partnership with
Intempora© 2017 – 03
Over 15 years of experience in providing advanced solutionsHistory
Multisensor Technologysince 1998!
Video speed: 1x. Over 100 kmh | 65 mph
• Darpa Challenge 2007 (Dotmobil Team)
• NAVYA ARMA
Intempora© 2017 - 04
ADAS & AD Challenges
Challenges ADAS and AD
Intempora© 2017 – 06
3
Offline development
5
Development costs / Time to market
2
Execution performance / Number crunching
1
Time coherency in distributed/multi-core multisensor applications
6
Test & validation
Ease of use / Ease for deployment
4
RTMapsmiddleware
Intempora© 2017 - 08
OutputInput
ActuatorsMotor, Wheel, Brake,Database, V2X
SensorsVision, RADAR, LiDAR, GPS, Maps, IMU, V2X
DATA PROCESSING
RTMaps - Real-Time Multisensor applications
FeaturesGraphical interface
Large library of off-the-shelf components
Record / Playback
Optimized (multithread, pre-allocatedbuffers, copyless)
Preserves time coherency
Intempora© 2017 - 09
Applications
Intempora© 2017 - 10
Positioning & Navigation
SLAM
HMIs
Computer VisionBig Data / Cloud
Perception
2D/3D
Machine Learning
Data Fusion
ADAS toolchain(VEOS, ControlDESK, MicroAutoBox)
Interoperability
Digital maps
Signal processing & Control Actuators(Simulink, MathWorks)
Image processing(OpenCV, others libraries…)
Communication(DDS, TCP, UDP, LCM, …)
Advanced HMIs(Qt, QML)
Simulators(MotionDesk, ASM, PreScan, Pro-SiVIC..)
Robotics(ROS bridge)
RTMapsSensors / Actuators
Intempora© 2017 - 11
Intempora© 2017 - 12
SDK / Develop your own RTMaps components
A cross platform / multi-language API
C++PythonSimulinkQML
Intempora© 2017 - 13
…
Model-based controller design
Model-based perception
High performance sensor data processing
⋮
…⋮
ActuatorsSensors Perception Applications
Data processing, Data fusion,
tracking
↓
SceneInterpretation
↓
EnvironmentModel
fcn 1(ECU a)
fcn 2(ECU b)
fcn 3(ECU b)
GigEMATLAB/Simulink
Model based perception
RTMaps workflow
4 Embedded in prototype(PC+ dSPACE)
2In-vehicleData Recording
3 Offline DataPlayback
5 PrototypingRTMaps appsto embeddedtargets
From R&D to production
From COTS solutionsto custom developments
1 OfflineSimulation
6 RTMaps applications to embedded ECU
Intempora© 2017 - 15
RTMaps Embedded & NVIDIA
Nvidia JetsonTegra K1
Nvidia Drive PX
RTMaps on Nvidia boards since 2013
Nvidia JetsonTegra X1
Nvidia Drive PX2
• ELA Project 2013Automotive Electronics and Software
RTMaps Embedded on ARM architecture
2014 2015 2015 Today Q3 2017
SPU
?
Intempora© 2017 - 17
ARM
GPU
OS
• RTMaps Runtime engine runs on the ARM CPU
Intensive computing taking advantage of hardware acceleration
Intempora© 2017 - 18
• Components (image processing for instance) canwrap intensive computing algorithms takingadvantage of GPU
• Supported OS: Windows, Linux, Embedded Linux (Yocto/Poky)
• Supported OS: Windows, Linux, Embedded Linux (Yocto/Poky)
RTMaps Embedded
Intempora© 2017 - 19
• RTMaps Runtime Engine and components compiled on chosentarget
• RTMaps SDK for cross-compilation on a Linux PC, or available directlyon the target
• RTMaps Studio operating on separate laptop with direct SSL connection with the runtime engine on the target. Used for diagrams edition (design and configuration).
SSL
Work & Edityour algorithms
from PC
Easily deployon board
RTMaps & NVIDIA DriveWorks
Nvidia_DriveWorks
Intempora© 2017 - 21
*Easily deploy on target with RTMaps Remote Studio (SSL)
RTMaps & NVIDIA DriveWorks
DriveWorks Components (C++ / CUDA) DRIVE PX 2
etc…
*
DriveNet
LaneNet
Feature Tracker
RTMaps
Conlusion: Video Live DemonstrationReduce and enhance your development cycles
Intempora© 2017 - 22
RTMaps & NVIDIA DriveWorks
Intempora© 2017 - 22
RTMaps & KITTI
Thanks for your attention
https://intempora.com@INTEMPORA #GTC17 #RTMaps
Nicolas du LacCEO, Intempora
To see live demonstrations, meet us on booth #1105 with dSPACE Inc
Evaluate RTMaps!1- Download RTMaps from intempora.com2- Send an activation request at
[email protected] | Tel. +1 248 295-4700