driver replacement: ad/adas overview
TRANSCRIPT
Company Public – NXP, the NXP logo, and NXP secure connections for a smarter world are trademarks of NXP
B.V. All other product or service names are the property of their respective owners. © 2018 NXP B.V.
Gavin Zhang
Driver Replacement: AD/ADAS Overview
June 2018 | AMF-AUT-T3236
COMPANY PUBLIC 1
MILLION1.3
90% are caused by
HUMAN ERROR
OUT OF ALL ACCIDENTS GLOBALLY,
22m/h
31m/h
44m/h
HIT BY A VEHICLE
TRAVELING AT:
HIT BY A VEHICLE
TRAVELING AT:
HIT BY A VEHICLE
TRAVELING AT:
9 OUT OF 10 PEDESTRIANS SURVIVE*
5 OUT OF 10 PEDESTRIANS SURVIVE
ONLY 1 OUT OF 10 PEDESTRIANS SURVIVES
Source: Seattle’s Vision Zero Plan/Documents/Departments/beSuperSafe/VisionZeroPlan, ASIRT.ORG
Road traffic deaths occur every year
COMPANY PUBLIC 2
Better senses than the human driver.
Automation of driving decisions.
SENSE
THINK
ACT
Enabling Self-driving Cars
COMPANY PUBLIC 3
More than a brain on four wheels.
The core of safe and secure mobility.
LEVERAGING
Leadership in processing, security and
mobile
SENSE THINK ACT
Architecting the Car
of the Future
COMPANY PUBLIC 4
Computation PerformanceLead the heterogeneous compute performance with
purpose built processors, optimized for power
SafetyNo compromise on safety. Progression from ASIL to
enhanced dependability and fail operational modes support
Ease of UseBased on OPEN standards, portable and relocatable
Modularity ScalabilityBuilt on ‘clear functionally separated extensible’ entities
NXP Core Values to Solve
the Current Challenges of
the Market
COMPANY PUBLIC 5
0
LEVEL5
LEVEL
LEVEL
LEVEL
LEVEL
2
3
4
FullAutomation
HighAutomation
ConditionalAutomation
PartialAutomation
Driver
Assistance
+$700
+$600
+$400
+$100
+$50
Level 0-2
Level 3-5Automated
Driving SystemPerforms entire dynamic driving
task/monitors environment
Human DriverPerforms part of dynamic driving
task/monitors environment
1
No
Automation
Source: Strategy Analystics; IHS; Evercore; ABI Research; NXP
Semi Content per Car increase (TAM) vs Level 0
Autonomous Driving
COMPANY PUBLIC 6
Typical Vehicle Architecture
5 Level
4
3
2
1
8-12 6-12 8-12 1-3 Yes >200k DMIPS, >50 TOPS ?
8-12 6-12 8-12 1-3 Yes 200k DMIPS, 50 TOPS 4TB
4-8 0-3 0-1 no <10k DMIPS
8-12 4-8 3-8 0-1 Yes 60k DMIPS, 5-10 TOPS
8-12 3-5 1-3 no 20k DMIPS, 1 TOPS
Level
Level
Level
Level
U-sonic Radar Imager S.S. Lidar V2X Cloud Conv SIG. Proc/ML &/ DL Storage
AI
AI
AI
AI
Higher Levels of Automation: Higher
Computation, Storage & Sensors
COMPANY PUBLIC 7
2018 2020 2022
• AEB Pedestrians
• AEB Cyclists
• AEB Urban
• Emergency Lane Keeping
• Lane Keep Assist
• Junction / Cross Traffic Assist
• Auto Emergency Steering
• Reverse AEB
• Driver Monitor
• AEB Pedestrians
• AEB Cyclists
• Auto Emergency Steering
• AEB Head on
• Evasive Steering and AEB
• Child Presence Detection (DMS)
Driving Safety Features
COMPANY PUBLIC 8
10X the performance of today’s best performing safe automotive platforms1
Reduces software
development effort by 90% within application domains, and by more than
40% across application domains2
Delivers new levels of automotive safety,
security and over-the-air (OTA) capabilities
1 Based on publicly available competitor roadmap performance statements.
2 Based on analysis of existing NXP software code in existing customers’ applications, NXP expects that software reuse will be significant both
within domains and across vehicle domains at up to 90 and more than 40 percent respectively.
S32 Automotive
Processing PlatformAnnounced Oct 16, 2017
COMPANY PUBLIC 9
2-3x more ASIL D
compute performance
than ANY competing
solution
1st ever Arm Cortex-A
with ASIL D
Industry’s most
powerful Hardware
Security Engine
(HSE)
Firmware upgradable,
Public Key
Encryption, Side
Channel Attack
Prevention
Common Hardware
enables common
software
(Common Chassis)
As much as 90%
software reuse within
application domains
Over-the-Air capability
across all vehicle
domains
1st scalable auto OTA
capability (encrypted
external NVM, wide
memory range, read
while write)
Highest performance
auto MCUs
Ideal for domain
control
Massive compute
increase with
application specific
solutions
1st Arm® based
automotive
MCU/MPU platform
top to bottom
Supports Arm
Cortex®-A, -R, and -M
cores
• Automotive-grade scalable technology platform
• Common hardware and software
Performance Arm Safe Secure OTA SW Reuse
S32 Platform: Hardware that Enables Software Without
Compromises
• Industry leading performance and features
• Across all our automotive MCU/MPU’s and application areas
COMPANY PUBLIC 10
Safety Radar Gateway Vision
Braking
Island
Arm Cortex
Interconnect
Memory
Radar
Island
Gateway
Island
Vision
Island
General
Purpose
Island
General Purpose Autonomous
Fusion
Island
DebugSecurity
Safety
Common Chassis
One Common Architecture Base
• Fixed set of Cores and Interconnect
• Consistent Safety Concept & Security
• Identical Base Peripheral set
• Consistent Boot and Debug
Peripherals
Application Specific Support
• Cortex-A/R/M Processors
• Accelerators
• Analog Subsystems
• Peripherals and Memory Interfaces
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
Arm Cortex
Interconnect
Memory
Common Chassis
A Common Hardware Architecture PlatformMaximizes hardware and software reuse across product and applications
COMPANY PUBLIC 11
NXP LEADS DOMAIN BASED
VEHICLE ARCHITECTURES
COMPLETE
SOLUTIONS FASTER TIME TO MARKET
FULL SCALABILITY
Connectivity
Driver Replacement
Powertrain & Vehicle Dynamics
Body & Comfort
In-Vehicle Experience
SENSE THINK ACT
Body & Comfort
In-Vehicle
Experience
Powertrain &
Vehicle Dynamics
Camera
Lidar
Ultrasonic
Cockpit Domain
Controller
SensorFusion
& Planning
PowertrainDomain
Controller
BodyDomain
Controller
Touch Displays
Voice Recognition
Radar
HVAC, Interior Lighting
Doors, seats, steering wheel,
mirrors, wipers, sunroof
Powertrain &
Vehicle Dynamics
eCockpit
Amplifiers
Temp, Light, Humidity
Switch Panels
Motion & Pressure
Speed Engine
Transmission
Brake
Battery Cell Management
Steering
Airbag
Suspension
Connectivity Domain
Controller Cellular
WiFi, BT, GNSS, NFC
V2X
Broadcast Radio
Smart Car Access
Connectivity
Driver
Replacement
COMPANY PUBLIC 12
RadarEvolves to 360° view with high performance integration
COMPANY PUBLIC 13
Performance FeaturesTools & Support
• Robust performance
under all conditions
• Miniaturization / cost
effectiveness
• Improved Perception: height,
imaging, classification
• High 360° detection
performance of static and
dynamic targets
• Efficient simulation tooling
• 3D construction combined
with simulation
• Support for sensor validation
& virtual validation
• Standardized Interface
(Measurement, Debugging &
Vehicle Connectivity)
• High data rate
interconnectivity to record and
replay sensor data
• Testing capability at all
processing stages – from
antenna to object data
Radar Sensors
COMPANY PUBLIC 14
Industry
Drivers
Demand for
Silicon Innovation
RFCMOS
Radar
Enabling New
Types of Sensors
Enabling
Cocooning
• Precise range, approach
speed, angle data
• Short-, mid-, long-range
functionality
• Multi-target
discrimination
• One radar for multiple
safety systems
• Autonomous Functions
−Braking
−Parking
−Steer, Stop & Go
• Towards full auto-pilot
• Regulations to protect
• Vulnerable Road Users
−Pedestrians
−Bikes
• Silicon Technology
• Smaller feature size
−Faster RF
−Faster Digital
−Lower Power
• Fast Chirp76-81GHz Radar−High resolution−Direct speed & range measurement
−Low power consumption−Small footprint−Ease of application
• Increased
−mmWave performance
−Processing power
−Integration level
−Scale economies
RFCMOS
Radar
Transceiver
RFCMOS
1-chip
Radar
• Small
• Affordable
• High Resolution
• Radar Sensors
• High
Performance Radar
−Multi Frontends
−Strong Radar MCU
0-120m
> 250m
77GHz RFCMOS Radar – A Logical Choice
COMPANY PUBLIC 15
Transceiver
Processor Power
Management
CAN / Ethernet
Industry 1st postage stamp sized radar solution
Field Tested by
and HELLA
NXP System Solution Leadership at Work
COMPANY PUBLIC 16
50%radar modules use
NXP radar technology in 2016
S32R#1 in Radar Processing Integration &
Performance Per Power
Central
Smart Radar
Integrated
Smart Sensor
Multi Mode TX/RX
S32 R4x
Time
2015-2017
2016-2018
Inte
gra
tio
n
2013-2015
MPC5775K MPC5775K
S32R
Next Gen
Front & Rear Radar
360° Multi-Mode
Smart Radar
Software Defined
Radar
Scalable, highly integrated, safe and
secure family driving the digitalization of
radar and sensor data fusion.
#1 Radar MCU Provider
COMPANY PUBLIC 17
Application Context for SRR and MRR: Tomorrow
MULTI-MODE
MRR/SRRNCAP Lateral Assist,
Evasive Steering, Highway
Pilot
TOMORROWRadar Network
Fusion;
NCAP Domain Controller
MULTI-MODE
MRR/SRRJunction Assist, Cross
Traffic,
Evasive Steering
LONG RANGE
HIGH RESOLUTION
RADARAdaptive Cruise Control
Automatic Emergency
Braking
Forward Collision Warning
COMPANY PUBLIC 18
Vision: Market Leading Performance
Driver Monitor
Camera3D Positioning
Driver Alertness
Driver Awareness
Surround View
VISION3D Segmentation
Highway Autopilot Assist
Park Assist
Pedestrian Detection
NCAP Camera
VISIONPedestrian Detection, Lateral Tracking
Automatic Emergency Braking
Collision Avoidance
Rear View
Sensor Fusion
Camera / RADARSafe Decision Making
Vision: Market Leading Performance
COMPANY PUBLIC 20
S32V – ADAS Vision ProcessorsMPC560x
Surround ViewSCP2200
Rear View
Time
2016-2018
Pe
rfo
rma
nce
MPC5775K S32 V23x
Next-Generation
Safe Open Vision
Predictive Vision
1stEthernet Camera MCU & Embedded
Integrated Ethernet PHY
1stTrue ASIL B Hardware Only Vision Platform
True automotive reliability
High performance/power, and true safety
Guaranteed security and connected network
Built on highly performing fully abstracted accelerators
Ecosystem of software and tools (mCAL-Linux- Vision SDK)
S32Vx
Front View & Fusion
2015-2017
MPC5775K MPC560x Surround / Rear View
125° C
COMPANY PUBLIC 21
Probabilistic• Analyze Scenario
• Make Contextual Decision
Deterministic• Initiate Safe Measure
• Fail Safe / Operational
Automated
Drive
Co-pilot Collision
Avoidance
Self Parking Lane Keeping Collision Warning Sign View
Super Computing Safe Computing
Number Cruncher
LAYERSCAPE
Safety Processor
S32V234
x xx x x xx x
$
x xx x
$
Rising Computing and Safety Requirements
COMPANY PUBLIC 22
Automation of Driving DecisionIndustrializeable, low power, secure
COMPANY PUBLIC 23
BlueBox Engine: Central Processing Unit For Autonomous
Driving
Highly Optimized Sensor Fusion
Security
• Various sensor data streams: Radar, Vision, LiDAR,
V2X
• S32V234 automotive vision and sensor fusion
processor
• LS2084A embedded compute processor
• S32R27 radar microcontroller
• CSE and Arm TrustZone® technology
High Performance per Power• Up to 90,000 DMIPS at < 40 W
• Complete situational assessment
• Supporting classification
• Object detection and localization
• Mapping
Ease of Development• ROS Space
• Open ROS Space Linux®-
based system
• Programmable in linear C
• Easily customizable
• Development environment for
mainstream vehicles
• Global Path Planning
• Behavior Planning
• Motion Planning
Decision Making
COMPANY PUBLIC 24
Ultrasonic
Lidar
Radar
Camera
V2X
Ԧ𝑎, 𝜔Acceleration
Rotation
Ԧ𝑣 Speed
S12
S32V
S32R
S32V
i.MX
PPC
S12
SENSE THINK ACT
Level 2 & 3 Automated Driving Level 4
Data
Fu
sio
n
Co
mb
ines S
enso
r ‘o
bje
cts
’ in
on
e
MA
P
Rela
tio
n A
sse
ssm
en
t A
sse
ss S
itu
atio
n
Decis
ion
Pre
dic
t a
nd
de
cid
e f
or
Actio
n
i.MX
MCU / MPU / DSP
RF
Analog
Sensors
Learning: BlueBox
Development System
S32V & S32R
Vehicle Control• Engine control
• Transmission
• Brake
• Steering
• Airbag
• Suspension
Instrument cluster
Infotainment
Sensor processing creates data objects
Sensor Fusion and Highly Automated Driving
COMPANY PUBLIC 25
SAFE AND SECUREMOBILITY AT THE HEART OF
AUTONOMOUS DRIVING
NXP, the NXP logo, and NXP secure connections for a smarter world are trademarks of NXP B.V. All other product or service names are the property of their respective owners. © 2018 NXP B.V.
www.nxp.com