Neuroscience Applications in e-Navigation Usability Issues

Prof. N. Nikitakos – D.Papachristos (Ph.D. cand) Dept. of Shipping Trade and Transport, University of the Aegean

Digital Ship - Nov. 27-28, 2012 - Athens

www.stt.aegean.gr

CONTENTS •Introduction •Neuroscience •e-Navigation •Marine Usability •Proposed Research Framework •Conclusions

www.stt.aegean.gr

Introduction

www.stt.aegean.gr

Introduction (1)

the study of usability user experience Accessibility Aesthetics emotion affect ergonomics

www.stt.aegean.gr

Neuroscience

www.stt.aegean.gr

Neuroscience (1)

Neuroscience is the scientific study of the nervous system

traditionally, neuroscience has been seen as a branch of biology

the neuroscience is a interdisciplinary science that collaborates with other fields such as chemistry, computer science, engineering, linguistics, mathematics, medicine and allied disciplines, philosophy, physics, and psychology

www.stt.aegean.gr

Neuroscience (2)

the nervous system is the most complex organ system in the body

The human brain alone contains around a hundred billion neurons and a hundred trillion synapses

The study the nervous system focus: how it is structured, how it works, how it develops, how it malfunctions, and how it can be changed

www.stt.aegean.gr

Neuroscience (3)

Brain Synapse

www.stt.aegean.gr

Neuroscience (4)

Today the use of the consolidated strategic research that is called cognitive neuroscience and includes the study of the behavior and the external situations related to it, as well as the expansion of the nervous system mechanisms that intervene in this relationship, leads to a better expansion of the user’s physiological reactions

www.stt.aegean.gr

Neuroscience (5)

Cognitive neuroscience topics: Attention Change blindness Consciousness Decision-making

www.stt.aegean.gr

Neuroscience (6)

For example, there are too few studies of the interactive technologies at the ship’s bridge (e.g. Grootjen et al, 2006; Goulda et al, 2009), which focus on the ‘cognitive ergonomics’ aspects of use.

www.stt.aegean.gr

Neuroscience (7)

More specifically, these studies tend to report on usage effects on health, safety and mental workload; however they offer little guidance on the evaluation methods and/or the design of the respective technology and equipment (devices) with respect to usability.

www.stt.aegean.gr

Neuroscience (8)

The measurement methodology must fulfill all three requirements of the cognitive Neuroscience: experiential verification operational definition repetition

www.stt.aegean.gr

Neuroscience (9)

Some neuroscience tools: Eye tracking fMRI EEG Sentiment analysis in speech Face analysis

www.stt.aegean.gr

Neuroscience (10)

www.stt.aegean.gr

e-Navigation

www.stt.aegean.gr

e-Navigation (1) IMO has recognised the e-navigation offers: reliability Effectiveness The initial definition for e-Navigation was formulated by

IALA thus: he harmonized collection, integration, exchange, presentation

and analysis of marine information onboard and ashore by electronic means to enhance berth to berth navigation and related services for safety and security at sea and protection of the marine environment

www.stt.aegean.gr

e-Navigation (2)

IMO’s goal is to develop an e-navigation strategy underpinned by user needs, so that technology can be applied appropriately

“E-navigation is a opportunity to drive technological innovation towards enhanced navigation safety”

Satellite for GPS

www.stt.aegean.gr

Marine Usability

www.stt.aegean.gr

Marine Usability (1)

Usability has been defined by ISO 9241 as “the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use”.

www.stt.aegean.gr

Marine Usability (2)

Effectiveness means accuracy and completeness with which users achieve specified goals (ISO 9241)

Efficiency means resources expended in relation to the accuracy and completeness with which users achieve goals (ISO 9241)

Satisfaction means freedom from discomfort and positive attitudes towards the use of the product (ISO 9241)

www.stt.aegean.gr

Marine Usability (3)

Usability test means a test aiming to evaluate usability of a product with real users. There are two types of usability test :

summative usability test (rate, efficiency and satisfaction, and evaluate overall usability of the product)

Formative usability test (to identity, analyze and improve potential usability problems)

www.stt.aegean.gr

Marine Usability (4)

Cognitive ergonomics. For example, usability assessments in interactive technologies at the ship’s bridge

Usability testing

Ship’s bridge

www.stt.aegean.gr

Marine Usability (5) Timing

Selection of test participants

Setting of tasks

Preparation for tests

Implementation and record

Evaluation and analysis

Report of test results

I. Planning

II. Preparation

III. Implementation

IV. Analysis

Process of summative usability test

www.stt.aegean.gr

Marine Usability (6)

According to Osterman et al. (2010) “several models and methods have been developed to estimate costs and benefits of ergonomics in other industries, but no studies

were found from the shipping industry”

www.stt.aegean.gr

Marine Usability (7)

Example: Usability assessment ship’s bridge equipment Various interactive technologies and systems to assist ship command designed with usability to allow ease of use and not pose additional burdens to marine officers

www.stt.aegean.gr

Marine Usability (8)

Marine usability testing

www.stt.aegean.gr

Proposed Research Framework

www.stt.aegean.gr

Proposed Research Framework (1)

multi-method approach usability assessment ship bridge interactive systems the physiological data (gaze tracking & speech

recording) emotional user responses usability testing

www.stt.aegean.gr

Proposed Research Framework (2)

Why? the necessity of a mixed approach to usability

evaluation Need for a generic, but practical framework More objective measurements

www.stt.aegean.gr

Proposed Research Framework (3)

SCOPE Ship’s bridge euipment in modern ship: new technology for navigation (i.e. GPS, radar), computer tools supporting (i.e. electronic

cartography-ECDIS) Steering Control Consoles Helm unit and Lee Helm

www.stt.aegean.gr

Proposed Research Framework (4)

The main elements of the proposed approach include: Registration and interpretation of user emotional states Gaze tracking and interpretation Speech recording and lexical analysis (sentiment

processing) Usability testing procedures Usability questionnaires Wrap-up interviews

www.stt.aegean.gr

Proposed Research Framework (5)

Influence

Personality Personal

background

Expectations-interesting

Evaluation

user

mood

Software tool

Scenario

DM interaction

measure

Gaze tracking &

head movements

During the interaction

Speech (text)

Before-After interaction (mood, meta experience

emotion)

incentive

emotion

Psychological

phenomenon

Targets: •Correlation Influence – Affect Situation (AS)

•Confirm psychological theories •Correlation Speech (text) – AS •Correlation Gaze tracking & head movements - AS •Correlation Emotion (happy, sad) - Satisfaction (educational using, usability)

Satisfaction (by using)

t

Pr, Pm, p_b, Exp_In, Eval

influence

good bad mood

happy sad Emotion

yes No satisfaction

appraisal

Affective information

observation

www.stt.aegean.gr

Conclusion

www.stt.aegean.gr

The approach is general in the sense Applied in various types of systems Plurastic Require further adaptations to accommodate

evaluation of particular interactive systems

Conclusion (1)

www.stt.aegean.gr

A further extension of this work shoot include usability testing methods at ships bridge∙ an

example recent work of this respect hand been proposed by Japan research team in Sub –

Committee on Safety of Navigation, IMO (IMO, 2012)

Conclusion (2)

www.stt.aegean.gr

Thank you nnik@aegean.gr