HOW TO DEAL WITH ALL THE DATA THAT IS GENERATED BY THE VEHICLE SENSORS?Seán Gaines, Vicomtech-IK4. Bordeaux 20151007

How are We?

Applied Research Centre, founded in 2001, specialising in Computer Graphics, Visual Computing and Multimedia technologies

Location:

Paseo Mikeletegi 57Parque Científico y Tecnológico

de Gipuzkoa20009 San Sebastian

Spain+34 943 30 92 30

Vroom Vroom…

Where is my Jet Pack? Semi/Autonomous driving by 2020? What do I get on the way? How can data and data analytics enable

this?

What do consumers say the want?

Active Safety was requested by 78% of respondents

Assisted Driving by 77% of respondents Location-based Services by 67% of respondents Alternatives to petrol engines by 65% of

respondents Digital-device integration by 64% of respondents Connectivity by 60% of respondents*

Source: Boston Consultancy Group

What are the challenges? Loosing data On-board analysis of data “Data Factories and Tooling” Exploiting connectivity (closing the loop) Nailing the HMI nail on the head Product recall/liability Software security, safety and formal methods Car manufacturers and Tier 1s as Software Houses Changes in how we learn to drive, privacy,

ethics….

Where is the data coming from?

Outside: Lidar, Radar, Ultrasound, Cameras, etc. Inside: Cameras, Mics, etc. Inherent: Engine and Vehicle Management,

Telemtry, etc. Elsewhere: V2V, V2i, Internet, 4G, etc.

Source: Analgoue Devices, Financial Times

What trends are creating data?

Lots….. But let’s look at just one. Cameras:o The average mid-range car will have 10 cameras by 2020o CMOS Image sensor market was valued at 8.4BN USD in

2014o 29.4 Million cameras sold to Automotive industry in 2014o In 2020 the volume is estimated to grow to 102M units

p.a.

Source: Financial Times, Asian Financial Report

External Cameras - 360° Lane Departure Warning Collision Avoidance Blind Spot Detection Parking Assist Systems Pedestrian and cyclist Detection Road and Traffic Signal Detection Precise Lane Level Navigation Free Space Detection Local Dynamic Maps Road Osculation Detection

Internal Cameras - 360 ° Fatigue Detection Drowsiness Detection Gaze Estimation Head Pose and Orientation Acoustic Environment Traits Analysis Gesture Analysis Driver Authentication

Data Fusion – beyond 720 °

Event Detection and Prediction Scene Understanding Holistic Driving Models Risk Prediction Continuous Monitoring HMI Response Single Channel HMI fusing multiple ADAS

systems Personalised Driver Models

Vehicle Data Lifecycle Starting with Big Data and creating Big Data Technologies:

o Petabytes of Test Video, Mapping and Sensor datao Annotation of video and data (on the Cloud please)o Create new ADAS Algorithms and softwareo The annotated video will be used to create ADAS algorithms and New

Digital Maps as validation of the value of the annotated datasets. Moving from Big Data to “Little Big Data”:

o ADAS software is updated to your Car, GPS or Smartphoneo Vehicles do lightweight real-time analysis of sensor data using spare

cycles on on-board computer….. Lots of vehicles Closing the loop:

o Device and Car connectivity, in its analysed form will be sent back to the Cloud

o This data is passed through the data factory again closing the loop

A picture, please…

Questions?