software framework for highly automated driving eb robinos · software framework for highly...

20
Software Framework for Highly Automated Driving – EB robinos Jared Combs July 27, 2017

Upload: others

Post on 16-Aug-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

Software Framework for Highly Automated Driving – EB robinos

Jared Combs July 27, 2017

Page 2: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

2

Radar

Camera

LIDAR

Sonar

Steering Wheel Sensors

Wheel Speeds

IMU / Gyro

Global Position

Maps

Motor Speed Control

Brake Pressure

Steering Angle Control

Regenerative Braking

Static obstacles

Lanes

Moving objects

Vehicle ego motion

Signs

Trajectory planning &

control

Fail-safe / -degraded

mechanisms

Head Unit

Side Tasks

Functional safety

Redundancies

Items to specify: 24.

0

5

10

15

20

25

30

2002 2004 2007 2010 2013 2015

Items to specify

1999: Mercedes S-Class Distronic

2002: VW Phaeton ACC

2005: Mercedes S-Class Distronic plus

2010: Audi A8 GPS-guided ACC

2006: Audi Q7 ACC plus / AEB

2013: Mercedes S-Class Dist.+ / Steering Assistant

2015: Audi Q7 Traffic Jam Assistant

+ brakes + sensor fusion + GPS maps + steering + automatic steering

Page 3: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Sensor Data Fusion

Software Framework for Highly Automated Driving

3

Radar

Camera

LIDAR

Sonar

Steering Wheel Sensors

Wheel Speeds

IMU/ Gyro

Global Position

Maps

Static obstacles

Lanes

Moving objects

Vehicle ego motion

Signs

Interactions: 𝒏 +𝒎+ 𝐤 for 𝒏 sensors, 𝒎 functions, 𝒌 abstraction components

Automated Driving

Automated Emergency Brake

Automated Valet Parking

Page 4: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

4

Page 5: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

Software Framework for ADAS and Automated Driving

5

Interfaces for • Interoceptive sensors – wheel ticks,

steering angle, accelerometers / gyros • “Smart“ environment sensors – point

clouds, object lists • ADASISv2/3 for map, SENSORIS for cloud

Integrated safety concept • System health monitoring and diagnosis • Safe-state triggering • Options for redundant environment

model and functions (e.g. minimal risk

Interfaces for • Kinematic vehicle components • Instrument cluster • Infotainment display

www.open-robinos.com

Trajectory Control

Longitudinal Control

Lateral Control

Positioning

Object Fusion

Grid Fusion

Behavior

Road & Lane Fusion

Vehicle Database Fu

nct

ion

Sp

eci

fic

Vie

ws

Ve

hic

le A

bst

ract

ion

- S

en

sors

Ve

hic

le A

bst

ract

ion

- A

ctu

ato

rs

Motion Management

Safety Management

Behavior

Behavior

Situative Behavior Arbitration Sensor Data Fusion

HMI Management

Situation Analysis

Situation Analysis

Situation Analysis

Path Planning

Path Planning

Path Planning

Page 6: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential 6

Every software component has • scalable, documented and standardized interfaces to other components • exchangeable interfaces to the base system / OS • a pre-industrialized algorithm core

Software Framework for Highly Automated Driving

Page 7: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

7

Upgrade across models / Upgrade over time

NCAP

HAD

Map onto concrete ECU architecture

Ensure differentiation, shorten time to market

EB modules 3rd-party modules Your modules

Page 8: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

8

Trajectory Control

Longitudinal Control

Lateral Control

Positioning

Object Fusion

Grid Fusion

Road & Lane Fusion

Vehicle Database

Fun

ctio

n S

pe

cifi

c V

iew

s

Ve

hic

le A

bst

ract

ion

- S

en

sors

Ve

hic

le A

bst

ract

ion

- A

ctu

ato

rs

Motion Management

Safety Management

Behavior

Behavior

Situative Behavior Arbitration Sensor Data Fusion

HMI Management

Situation Analysis

Situation Analysis

Path Planning

Path Planning

Automated Valet Parking

Automated Valet Parking

Page 9: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential 9

Software Framework for Highly Automated Driving

Page 10: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Short/Mid-term Path Planning

Grid Freespace Extraction

Highway Driving

Positioning

Software framework in action

Software Framework for Highly Automated Driving

Page 11: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

Range of ego sensors are limited

Recognition algorithms are limited

Not all information needed can be derived from sensor observations

11

What about maps?

Page 12: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

12

Sensor-based Learning for Predictive Driving

• Secure connection

and transfer

Collect sensor data

1

• Data aggregation • Map matching • Sensor fusion

Sensor learning

2

• Enriched map

updates on

daily basis

Incremental NDS Compilation

3

• Delta maps

Incremental Map Update Service

4

Consumer experience

• Always up to date

electronic horizon for ADAS functions

5

2 3 4

5 1

Page 13: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

Trajectory Control

Longitudinal Control

Lateral Control

Positioning

Object Fusion

Grid Fusion

Behavior

Road and Lane Fusion

Vehicle Database

Fun

ctio

n S

pe

cifi

c V

iew

s

Ve

hic

le A

bst

ract

ion

- S

en

sors

Ve

hic

le A

bst

ract

ion

- A

ctu

ato

rs Motion

Management

Safety Management

Behavior

Behavior

Situative Behavior Arbitration Sensor Data Fusion

HMI Management

Situation Analysis

Situation Analysis

Situation Analysis

Path Planning

Path Planning

Path Planning

Page 14: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential 14

Boosting ADAS and Automated Driving

Software Framework for Highly Automated Driving

Page 15: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

DNA for Automated Driving and NVIDIA

15

EB robinos

EB Assist ADTF EB tresos

Software Framework for Highly Automated Driving

Rapid prototyping

C, C++, Model based

Rapid embedding

C, C++

Automotive grade software

ECU Evaluation hardware

PC

Page 16: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential 16

Software Framework for Highly Automated Driving

EB robinos + NXP BlueBox Software for highly automated driving

+ automated driving development platform

Page 17: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

EB robinos Processing Recorded Data

17

Software Framework for Highly Automated Driving

Path Planning NXP BlueBox

Sensor: IBEO Lux Gen4 at 12.5Hz

Board: NXP BlueBox

Runtime Environment: EB robinos Linux Environment

Grid on NXP BlueBox

Page 18: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

Open robinos

• specifies a reference platform for automated driving up to Level 5 (SAE) • architecture • interfaces • data flow • control mechanisms • software modules • functional safety aspects

• freely available and licensed as

Creative Commons

• Available for download

EB robinos

• implements the open robinos specification

• provides software modules • for prototyping

in EB Assist ADTF • for rapid embedding

on AUTOSAR / DRIVE PX • for production

on vehicle ECU

• developed, tested, verified

according to functional safety standards

www.try-eb-robinos.com

18

Download the open robinos specification

www.open-robinos.com

Page 19: Software Framework for Highly Automated Driving EB robinos · Software Framework for Highly Automated Driving Conclusion Software frameworks and functional architectures help to address

© Elektrobit (EB) 2016 | Confidential

Software Framework for Highly Automated Driving

Conclusion Software frameworks and functional

architectures help to address complexity

We should talk about software, not hardware architectures.

Q4/2016 – More EB robinos components The problem is not difficulty but complexity.

EB robinos is a software framework for automated driving, applicable across car lines and models – it is DNA for automated driving

19