advanced ip solutions enabling the autonomous … multi-core computer vision control cortex-a55 +...
TRANSCRIPT
© 2017 Arm Limited
Shanghai, Beijing, Shenzhen
Arm Tech Symposia 2017
Advanced IP solutions enabling the autonomous
driving revolution
Chris Turner | Director, Emerging Technology
& Strategy, Embedded & Automotive | Arm
© 2017 Arm Limited 2
Agenda
Autonomous vehicles
Heterogeneous processing
Arm IP in driving systems
Safety and security
© 2017 Arm Limited 3
Connected autonomous vehicles
Communication
5G cellularV2X
Processing
System on ChipSoftware
Cloud
Machine IntelligenceBig data
Sensing & Actuation
Computer VisionRadar, Lidar
© 2017 Arm Limited 4
Autonomous driving
Level 0
No Automation
Full-time human driver for all aspects driving, even with warning systems
Level 1
Driver Assistance
Mode-specific driver assistance of either steering or acceleration/deceleration with human driver for remaining task
Level 2
Partial Automation
Mode-specific driver assistance of both steering and acceleration/deceleration with human driver for remaining task
Level 3
Conditional Automation
Mode-specific Automated Driving of all dynamic driving task with human driver responding to a request to intervene
Level 4
High Automation
Mode-specific Automated Driving of all driving task, even if a human driver does not respond
Level 5
Full Automation
Full-time Automated Driving under all roadway and environmental conditions
Human Monitoring Machine Monitoring
© 2017 Arm Limited 5
Where are the challenges?
Complex and demanding compute requirements
High-integrity functional safety requirements
Multiple security issues and data privacy
© 2017 Arm Limited 6
Total automotive computing from Arm
Computer Vision
• Sensing and perceiving the driving scene
• Sensor fusion with radar, lidar etc.
Machine Learning
• Cognition
• Mission objective
Mapping
• 360 degree mapping
• Precision navigation
Decision & Actuation
• Course of action
• Real-time control
Arm Compute Library for fast deployment of CV & ML
© 2017 Arm Limited 7
Navigation & Infotainment
Energy-aware schedulingRich OSSecurity
Cortex-A75 + Cortex-A55 + Mali G51Vision ADAS
Heterogeneous multi-coreComputer Vision
Control
Cortex-A55 + Cortex-R52
Powertrain
Real timeHomogeneous multi-core
Cortex-R52Cortex-R52
Autonomous driving
High performance multi-clusterMachine LearningFunctional safety
Cortex-A75 + Mali G72 + Mali-C71 + Cortex-R52
Other modules
Radar
V2X
Chassis
Sensor
Audio
Security
Networks
Arm processors for automotive
Central body control
Low power Efficient performance
Scalable
Cortex-M7, Cortex-M0+
© 2017 Arm Limited 8
Safety and security
Safety and security are intimately related and some languages don’t differentiate:
安全, sécurité, Sicherheit, säkerhet, turvallisuus, …
Environment
System
Security Safety
SecurityProtects things and defends from malicious attack
SafetyLimits uncontrolled system behaviour to prevent harm
Data
Both guard against undesirable situations and together form a barrier that protects us and our things
© 2017 Arm Limited 9
▪ Cache parity / ECC▪ Exception handling▪ MMU▪ RAS features
Cortex-A55& future Cortex-A
Functional Safety throughout Arm CPUs
† availability dependent on processor
Cortex-M3/M4Cortex-M0+
▪ Exception handling▪ MPU▪ SW test library
▪ Cache parity / ECC†
▪ Exception handling▪ MMU
Cortex-AArmv8-A
▪ Dual core lockstep†
▪ ECC interface†
▪ Exception handling▪ MPU▪ Stack limit check▪ SW test library
Cortex-M33Cortex-M23
▪ TCM ECC interface▪ MBIST interface▪ Dual core lockstep▪ Cache ECC▪ Exception handling▪ MPU
Cortex-M7
▪ Virtualization▪ Bus protection▪ SW test library▪ System error▪ Bus ECC▪ Error management▪ TCM ECC▪ MBIST interface▪ Dual core lockstep▪ Cache ECC▪ Exception handling▪ Two-stage MPU
Cortex-R52
▪ Bus ECC▪ Error management▪ TCM ECC▪ MBIST interface▪ Dual core lockstep▪ Cache ECC▪ Exception handling▪ MPU
Cortex-R5
SIL3/ASIL D systematic capabilitySIL2/ASIL B systematic capability
© 2017 Arm Limited 10
Complete Arm solution for automotive SoC development
Solutions built from Arm IP
• Computing capability meets requirements• Within power and thermal constraints
• Accelerators• Task-specific processing complements mainstream computing
• System IP• Interconnect system IP delivering coherency and quality of
service required for optimum memory bandwidth
• Software programming environment• Managing complexity, ease of use, task separation
• Sub-systems• Efficient integration and communication, vehicle-wide
© 2017 Arm Limited 11
Mali-GPUs: Enabling tomorrow’s technology todayMali-G72 is Arm’s latest high-performance GPU, Mali-G51 provides mid-range efficiency
Optimised machine learning and computer vision
• Performance and efficiency for autonomous drive
• Face tracking and speech recognition for IVI
Advanced capabilities
• High fidelity graphics for latest displays
• Augmented reality for applications such as mirror replacement
Strong ecosystem
• Arm Compute Library for CV & ML
• QNX OS, graphics libraries and Linux drivers for IVI
Arm Mali is #1 for GPUs shipped
© 2017 Arm Limited 12
Image Signal Processing from Arm
Autonomous drive
• Ultra-wide dynamic range for lighting extremes
• Simultaneous support for human display and computer vision
• Every pixel reliable with real-time diagnostic capability
• Quad camera capability for cost efficiency
Cockpit
• Mirror replacement
• 360 surround view
• Road sign recognition
• Driver alertness
Mali-C71 designed for automotive vision
© 2017 Arm Limited 13
Arm compiler support for functional safety
Compiler safety package for software development in safety markets
• Industrial control, automotive, medical, transportation, military and others
Access to the safety package provided with DS-5 Ultimate and Keil MDK Pro
• Valid DS-5 or MDK support and maintenance entitlement enables extended maintenance
• Compiler installation is an add-on to the standard product installation
Functional Safety Certified
• TÜV SÜ D certification• ISO 26262 (ASIL D)• IEC 61508 (SIL 3)
Qualification Kit
• Development process docs• Safety manual• Defect report• Test report
Extended Maintenance
• Five year commitment• Technical support• Critical defect fixes
© 2017 Arm Limited 14
Arm TrustZone and Platform Security Architecture (PSA)Arm security throughout the SoC
Shifting the economics of security
• Easy and affordable
• Throughout the life-cycle
Endpoint-to-ecosystems security
• Sensors to cloud
Making security deployable at scale
• Throughout the vehicle
• Across the market
© 2017 Arm Limited 15
Arm solutions for automotive
Architecture and performance leadership for the car of the future
Best performance in tight thermal and space constraints
Safe and secure with ISO 26262, PSA and Arm TrustZone
Diverse and competitive supply chain to the automotiveindustry supported by a rich ecosystem
Comprehensive economic solutions throughout the vehicle
1616
Thank You!Danke!Merci!谢谢!ありがとう!Gracias!Kiitos!
© 2017 Arm Limited
1717 © 2017 Arm Limited
The Arm trademarks featured in this presentation are registered trademarks or trademarks of Arm Limited (or its subsidiaries) in the US and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners.
www.arm.com/company/policies/trademarks