assessment of the benefits of adas in field operational tests...adasis) 30 projects across 4...

1

Assessment of the benefits of ADAS in Field Operational Tests

Maxime Flament,

Head of Sector – SafeMobility,

ERTICO – ITS Europe

2

The Public-Private Partnership of ITS stakeholders in Europe

106 Partners

850 members i-Mobility Network

8 Different Sectors

2 deployment platforms (TISA, ADASIS)

30 projects across 4 continents

27 European & World ITS Congresses

Workshops & Fora

25 national ITS associations

We facilitate effective development & deployment of ITS

11 Dec 2012Journe Technicque SRA, Paris

3

Large Scale Field Operation Tests:

New tools for assessment of benefits

Assessing the benefit of intelligent in-vehicle systems

is a priority to trigger faster deployment across

Europe, with the aim of making our road transport

safer, more efficient, and more comfortable

• Main questions

• How does the driver use the system?

• What are the short and long term

effects?

• How can the systems performance be

further improved?

• Around 1000 vehicles on the roads

• with 8 functions tested

• by 10 vehicle brands

• in 6 countries

• Using state of the art technologies and

proven FOT methodology


4

Causes of accidents/incidents

Journe Technicque SRA, Paris 11 Dec 2012

Human Error Involved> 90%

Others(e.g. surroundings, weather, …)

Source: GIDAS Database

5

euroFOT Overview

• First European Large-Scale Field Operational Test on In-Vehicle Systems

• Total budget: Euro 22 million

• Total funding: Euro 14 million

• Project duration: May 2008 till June 2012

• Coordinator: Ford Research & Advanced Engineering Europe

• 28 partners from 10 different countries:

› 8 OEMs › 4 Suppliers› 6 Universities› 5 Research Institutes› 5 SMEs


6

euroFOT Objectives (1)

• Perform coordinated tests of Intelligent Vehicle

Systems with ordinary drivers in real traffic

• Investigate performance, driver behaviour, and

user acceptance

• Assess the impacts on safety, efficiency, and the

environment using collected data


7

euroFOT Objectives (2)

• Apply a common

European approach for

Field Operational Tests

• Improve public awareness

on the potentials of

driver support functions

and a wider socio-

economic acceptance


Test Management Centres

8Journe Technicque SRA, Paris 11 Dec 2012

Project plan

9

FESTA: the FOT Methodology


10Journe Technicque SRA, Paris 11 Dec 2012


Video analysis

Example - Incident

26. June 2011 Final Event Autoworl, Brussels

12

Functions under test


•Longitudinal control functionsForward Collision Warning (FCW)Adaptive Cruise Control (ACC)Speed Restriction System (SRS)

•Lateral control functionsBlind Spot Information System (BLIS)Lane Departure Warning (LDW)Impairment Warning (IW)

•Advanced applications Curve Speed Warning (CSW)Fuel Efficiency Advisor (FEA)Safe Human Machine Interaction (SafeHMI)


FOT final status

French VMC

German VMC Operation Centre 1German VMC

Operation Centre 2

Italian VMC

Swedish VMC

Target number of

vehicles35 100 100 40 0 15 15 500 100 80

No. of vehicles

participated FOT

35

(+5)

98

(+2)57 32 (20) 15 15 533 100 80

No. of vehicles

currently running

35

(+5)

98

(+2)57 0 2 15 3 401 100 15

No. of involved

drivers35 130 80 32 (20) 45 60 533 204 86

FOT start dateOctober

2010

April

2010

January

2011

June

2010

January

2011

August

2010

February

2010

February

2010

February

2010

May

2010

14

Tested functions


15

Longitudinal functions:

Speed Limiter and Cruise Control

» Speed Limiter (SL) prevents the car from

passing a user-

determined speed

» Cruise Control (CC) maintain your driving

speed at a user-

determined speed


16Journe Technicque SRA, Paris

Speed Limiter and Cruise control

» No impact on workload» Good acceptance over full period of use » SL: Reduced likelihood of observing an over-

speeding event or sudden hard braking

» CC: increased over-speeding, however reduction of strong jerk, critical time gaps, and

hard braking

» No critical or unexpected safety effects

11 Dec 2012

17


Adaptive Cruise Control

» ACC adjusts the speed of the vehicle

in order to follow the

preceding vehicle at

a given distance

» In case no vehicle is in front, the vehicle

adjust its speed to

the user-determined

speed


18

Adaptive Cruise Control (ACC)

» High acceptance in terms of perceived usefulness and satisfaction (stable over time)

» Driver expectations were fulfilled» More than 75% of the driver feel that driving comfort

and safety increases

» ACC perceived to be most useful on motorways» ACC has a positive influence on driver behaviour

(increased THW), which leads to increased safety

» Fuel consumption is reduced when driving with ACC

Future Development: Stop&Go ACC operating at full speed range



% o

f res

pond

ents

0%

10%

20%

30%

40%

50%

60%

Increased comfort slightly

Increased comfort significantly

No change Decreased comfort a little

Decreased comfort significantly

ACC leads to an increase of perceived driving comfort:

77% of drivers feel that ACC increases comfort

Perceived driving comfort (ACC)


Perceived driving safety (ACC)%

o

f r

esp

on

de

nts

40%

20%

60%

0%

80%

100%

Increases safety No change

ACC leads to an increase of perceived driving safety:

94% of drivers feel that ACC increases safety


0,0

0,1

0,2

0,3

0,4

0,5

0,6

0,7

0,8

0,9

1,0

ACC leads to a decreased number of critical situations: –80%

Num

ber

ofcr

itica

lsitu

atio

ns[1

/100

km]

Baseline

Treatment

Baseline Treatment

Number of critical situations, overall

Experimental phased

Number of critical situations (ACC)


-80%

-70%

-60%

-50%

-40%

-30%

-20%

-10%

0%

10%

20%

-73%

Change in t

reatm

ent

2%

16%

-67%

Average Speed Average THW # of critical

THW (

23


Forward Collision Warning

» FCW warns of vehicles ahead

approaching too fast

and too close.

» It precharges the brake systems

» In some cases, it may apply the brakes

automatically


24

Key Results:

Forward Collision Warning» Almost 70% of drivers feel that FCW increases

safety

» High expectations of drivers are mostly fulfilled» Acceptance (usefulness, satisfaction) is high and

stable over time

» FCW is perceived to be most useful on motorways» Drivers were not all positive to the audio-visual

warning

Future development:FCW with automated braking at low speed and pedestrian detection


25

Vehicle type

Road type

Usage (portion of the total

driving in treatment)

Changes between

baseline and treatment in

safety related measures in the

FOT data

Potential reduction in

rear end crashes

Potential reduction in the injury accident population per

road type in EU-27

Passenger Cars Motorway 51% 32 - 82% 16 - 42% 2.2 - 5.8%

Trucks Motorway 42% 14 - 36% 6 - 15% 0.2 - 0.6%

ACC+FCW potential benefit


26

Lateral control functions:

Lane Departure Warning (LDW)

Impairment Warning (IW)

LDW: warns drivers who unintentionally drift out of lane (crosses lane marker) works 60 km/h and above with lane marking present

IW: warns drivers whose lane keeping performance indicates drowsiness/prolonged inattention


27

Key Results:

Lane Departure Warning LDW

(for cars and trucks)» LDW was generally appreciated by drivers, i.e. they

found LDW useful, effective and intuitive

» However: LDW drivers indicated somewhat lower levels of satisfaction and lower willingness to buy compared to other ADAS functions

Next development:

» New evolution of LDW with steering interventions in Lane Keeping Systems (LKS) is well perceived


28

Key Results:

Impairment Warning IW (for cars)» IW rates highly positive in terms of acceptance,

satisfaction and usefulness› These ratings are stable, i.e. they do not change over time

» Many respondents feel that IW increases safety » Trust in IW is high and does not change with time

› Indicates that drivers agree with IW's assessment of their level of attention/drowsiness

The problem: how to offer meaningful opportunities for action?› You can’t stop and sleep everywhere,

it might take some time to get your hands on a cup of coffee, you may be close to home and hence tempted to continue driving, etc.


29

Lateral control functions:

Blind Spot Information System (BLIS)

» BLIS indicates if there is another vehicle

present in the blind

spot and works 10

km/h and above


30

Key Results:

Blind Spot Monitoring BLIS (cars)

» Usability and acceptance scores for BLIS are high

» This rating does not change over time» 80 % of drivers feel that BLIS increases safety» BLIS is perceived as most useful on highways in

normal traffic

» BLIS does not increase workload


31

Other functions:

Safe HMI – Navigation Systems

» Navigation systems and traffic

information

» Safe design and use aspects for driver

interface


32

Key Results:

Safe HMI- use of Navigation devices

» Drivers compensate for the distraction caused by handling a navigation system

› Change of speed› Following distance (time headway)› Lane keeping performance

» There is no indication that handling of navigation systems degrades driving safety

› Very few critical distance observed› Very few conflicts due to bad lane keeping› driving environment allowing lower attention


» Navigation systems are highly accepted and widely used, Built-in navigation systems are preferred to the mobile device

33

Navigation System handling:

Following distance (Time headway)


34

Navigation System handling:

Driver compensation

» Especially on urban & rural roads compensation in driving during system inputs

» No indication that more safety critical events occur during system handling


Built-in Mobile

Highway Rural Urban Highway Rural Urban

Activecompen-

sation

Speed > >>Lane keeping >> >>

Safety impact

Crit. distance

35

Other systems:

Curve Speed warning (test cars)

» based on 30 drivers with test cars

› CSW offers satisfaction and trust

› Mostly used on unfamiliar roads

› Feeling of safety increases while using

CSW


36

Other systems:

Fuel Efficiency advisor (trucks)

» based on 50 trucks› FEA results in a fuel

saving of 1.9%

› Indirect impact on safety


37

Conclusions

» euroFOT has done extensive analysis of the benefits of the Advanced Driver Assistance Systems (ADAS) available on the market› Much more data analysis could be done› Much more data could be collected› Sharing of data across test site has increased the

statistical validity of the results

» Strong positive results were shown for the combination of ACC and FCW with the potential to address a majority of incidents

» Insurance companies are offering new products with reduced premium when specific ADAS are present


38

Further results

» euroFOT deliverables:› Final Event Presentations are online › 18 public deliverables with > 1500 pages from 76 authors › 35.000.000 kilometers driven› Over 100 TB data collected

» Other sources of benefits of ITS:› ITS Benefits Database

http://www.itsbenefits.its.dot.gov

› iMobility effects databasehttp://www.imobility-effects-database.org

› FOT-Net wiki (catalogue of FOTs and methodology)http://wiki.fot-net.org/



The Consortium

4011 Dec 2012Journe Technicque SRA, Paris26. June 2011 Final Event Autoworl, BrusselsDate Name and Company www.eurofot-ip.eu

assessment of the benefits of adas in field operational tests...adasis) 30 projects across 4...

Documents