A T O U C H - B A S E D M U LT I - F U N C T I O N C O N T R O L L E R F O R A U T O N O M O U S D R I V I N G

J U N T I M A N A W I L A I J A R O E N & VA S I L E I O S G O L E M A T I SI X D C T H C H A L M E R S U N I V E R S I T Y O F T E C H N O L O G Y - S E M C O N - A I M M I T

TOUCH DRIVE

O U T L I N E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

We planned. We worked. Tirelessly.

R E S E A R C H Q U E S T I O N S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Problems were found. Hypothesis was then formed.

Will a tablet-based tactical controller, augmented with an overlay cover increase the efficiency of the interface, providing a clear distinction between the input and output functions?

How can a tablet interface be designed to keep the driver in the loop of the autonomous driving task by functioning as a tactical and tertiary controller, providing an easy switch between these modes?

S C O P E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Great work came with great responsibilities.

Semi-autonomous

Tactical features & Tertiary menu

Focus on visual modality

Driver as supervisory operatorGiven

design problem

D I V E R G E N C E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Literature Review - Requirement Elicitation - User Studies

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

What are things we are going to deal with?

+ +

Automation IVIS & ADAS Touch - Based Interface

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in automation

Levels of Automation

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in automation

Interaction between human & automation

Levels of Automation

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in automation

Interaction between human & automation

Levels of Automation

Trust and Controllability

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in automation

Interaction between human & automation

Levels of Automation

Trust and Controllability

Driver in the loop

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

In-Vehicle Information Systems (IVIS) and Advanced Driver Assistance Systems(ADAS)

Interference & Distraction

Complexity & Over-Reliance

Loss of situation awareness

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in touch - based interfaces

Why touch - based interface?

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in touch - based interfaces

Why touch - based interface?

why tablet?

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in touch - based interfaces

Why not?

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in touch - based interfaces

Rapidly increasing uses of tablet in everyday contexts

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in touch - based interfaces

Rapidly increasing uses of tablet in everyday contexts

then, What is the problem of using tablet in car?

L I T E R AT U R E R E V I E W

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

design challenges and limitations in touch - based interfaces

Utilization of tablet affordance

Intuitiveness & efficiency

Overlay cover for better affordance

R E Q U I R E M E N T E L I C I TAT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

listed out system requirements and use cases

R E Q U I R E M E N T E L I C I TAT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

listed out system requirements and use cases

Highway Driving

City Driving

Change Lane

Accelerate / Decelerate Stop

Take next exit

Turn left / right

Roundabout Stop Park

U - Turn

R E Q U I R E M E N T E L I C I TAT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

listed out system requirements and use cases

Input

Turn left / right

Change lane

Action related information : available actions, confirmation of actions, executing action

Output

Speed (accerelate / decerelate / stop)

Switching to infotainment

Speedometer

Alert Notifications (fuel and oil level)

U S E R S T U D I E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

participatory design - 'Build - Try - Express'

U S E R S T U D I E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

participatory design - 'Build - Try - Express'

Build Try Express

U S E R S T U D I E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

participatory design - 'Build - Try - Express'

U S E R S T U D I E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

participatory design - 'Build - Try - Express'

What did we get from this workshop?

U S E R S T U D I E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

participatory design - 'Build - Try - Express'

Patterns were found

Blank space to draw a gesture

Needs of additional info. - ETA - Environmental Hazards

U S E R S T U D I E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

participatory design - 'Build - Try - Express'

There are also interesting findings

U S E R S T U D I E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

participatory design - 'Build - Try - Express'

Highway Driving

Participants say:

There's nothing much to do here. I will trust the automation.

Facing obstacle

Participants say:

I concern about my safety. I need do something. I want more control.

I want to know everything!Then, participants also say

R E Q U I R E M E N T E L I C I TAT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

we then realized that...

Feedback is vital.Design solution therefore should provide a

sufficient amount of feedback.

T R A N S F O R M AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Design Iterations - Expert Evaluation

A F F I N I T Y D I A G R A M

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Beginning of 1st design iteration. An emergence of dominant ideas.

1 S T P R O T O T Y P E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

first batch of prototypes were crafted.

1 S T P R O T O T Y P E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

first batch of prototypes were crafted.

E X P E RT E VA L U AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Explore the possibilities with the help from experts.

ฉพร ะCriteria

ฉพร ะLayout ฉพร ะContent ฉพร ะAccessbility

ฉพร ะNavigation ฉพร ะSatisfaction ฉพร ะLearnability

ฉพร ะProgress and Interaction

E X P E RT E VA L U AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Explore the possibilities with the help from experts.

ฉพร ะAlignment is very subjective

5 IxD

experts

ฉพร ะCombination of both menus

can be a good thing to consider

ฉพร ะMore visual affordances!

ฉพร ะRevisit drag & drop gestures

2 N D P R O T O T Y P E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

time passed. things changed.

2 N D P R O T O T Y P E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

time passed. things changed.

C O N V E R G E N C E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Implementation - Validation - Result Analysis

I M P L E M E N TAT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

We designed. And we crafted thoroughly.

+ +

Android Studio Sketch 3 Git & Bitbucket

F I N A L P R O T O T Y P E

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

We designed. And we crafted thoroughly.

TA C T I C A L C O N T R O L

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

S P E E D S L I D E R

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

The evolution in designing for speed slider

Operational Tactical Tactical & Strategic

T E RT I A RY M E N U

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

We designed. And we crafted thoroughly.

O V E R L AY C O V E R

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Tacticle feedback and better affordances

ฆ

VA L I D AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Wizard and his magic

SpeedDisabled CommandsProcessing CommandsEnvironmental Alerts

Issued Commands

M O R E

VA L I D AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

What to validate?

U SUsability

Efficiency Effectiveness Satisfaction

Moreover,

VA L I D AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

What to validate?

U SUsability

Efficiency Effectiveness Satisfaction

U SSemi-Autonomous Driving Experience

Trust Controllability

VA L I D AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Simulate the semi-autonomous driving experience

VA L I D AT I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Simulate the semi-autonomous driving experience

Questionnaire

Manual Driving

Semi-Autonomous Driving

Free drive

Drive with given tasks

System Usability Scales

Interview

R E S U LT S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Rumors had it all...

Both system were efficient. There is no overall significant difference between two system.

R E S U LT S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

Rumors had it all.

Pros

Easy to use

Functions are useful

Some functions are hard to access (Eco-slider, 2nd turn)

Cons

Easy and fast switchingbetween modes

Misinterpretation of alerts

Unintuitive disabled commands

Divided attention

Fast to learn

D I S C U S S I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

There's always a room for improvement.

Driver in the loop

Driver as a supervisory operator

Gradual transition to autonomous cars

Tertiary control

Multimodalities

C O N C L U S I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

conclusion - ethical issues - future work

C O N C L U S I O N

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

To sum it up...

Feedback is vital.

Mutimodalities is a must.

(1) Dedicated tactical touch-based interface with overlay cover. (2) Multi-function touch-based interface

E T H I C A L I S S U E S

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

There always two sided of a coin

Deskilling

Misplacement of trust

Replacement of human

F U T U R E W O R K

I N T R O D U C T I O N D I V E R G E N C E T R A N S F O R M AT I O N C O N V E R G E N C E C O N C L U S I O N

One another iteration

Tablet placement

Audio & Haptic Feedback

More strategic functions

T H A N K Y O UAre there any question?