Behavioural Markers for K-Sim OffshoreKalyan Chatterjea – EMAS Training Academy & Simulation Centre

December 2014

ASIA/PACIFIC simulator user conference 2014

Cebu, Philippines, December, 2-3

Assessing Performance

Agenda

Behavioural Markers (BMs)

Categories for BMs

Examples of BMs

Maritime Education & Training Developing Competencies

Knowledge-based

Training (KBT)

Skill-based Training

(SBT)

Non-technical

Skills [NOTECHS]

…Traditional Classroom

covering underpinning

knowledge

...With the advent of STCW

Simulators were introduced

to impart technical proficiency

…With the revised STCW

2010, we need to hone

our soft-skills covering

all the non-technical

skills

Non-technical Skills & Organisational Safety

Now it is conclusively proven that, these

non-technical skills (also referred to as

Soft Skills) have significant influence in

Organisational Safety!

Organisational Safety – Prof Rhona Flin (Feb 2013)

Ref: http://www.kingsfund.org.uk/sites/files/kf/rhona-flin-safety-culture-kingsfund-feb13.pdf

Soft-skills

[NOTECHS]

Defining Safety – Prof Rhona Flin (Feb 2013)

Ref: http://www.kingsfund.org.uk/sites/files/kf/rhona-flin-safety-culture-kingsfund-feb13.pdf

The Health and Safety Executive in the UK

defines the safety culture of an organisation as

‘the product of individual and group values,

attitudes, and perceptions, competencies, and…

patterns of behaviour that determine the

commitment to, and the style and proficiency of,

an organisation’s health and safety management’.

Assessment of Behavioural Skills… Flight-crew Human Factors Handbook, Oct 2014

• The only realistic method available was the

observation of crew behaviour, and this is still the case

today.

• There are major problems with this method, mostly

stemming from its subjective nature; for example it is

not an inherently reliable system (one trainer may

judge things very differently to another, or even

themselves on a different day).

• In an attempt to resolve these issues, scientifically

established methods of behavioural observation were

adapted for use within aviation training and

assessment.

Assessment of Behavioural Skills… Flight-crew Human Factors Handbook, Oct 2014

• A well-established scientific method for recording and

analysing behaviour is the construction of lists (or

taxonomies) of behaviours that the scientists expect to

see (the items in the list can be called behavioural

descriptors).

• The observer refers to the list while watching the

activity (or a recording of it) and notes each of the

behaviours as they notice them occurring.

• This process is usually repeated for samples of

people.

Assessment of Behavioural Skills… Flight-crew Human Factors Handbook, Oct 2014

• Using scales of this sort, scientists can produce

data about peoples’ behaviour, and this can be

analysed alongside factors such as peoples’

performance.

• The adjustment of this sort of methodology for

assessing the behaviour of a flight deck crew

during a single session is still debated, but is

nevertheless firmly established in the form of

behaviour marker systems.

Assessment of Behavioural Skills… Flight-crew Human Factors Handbook, Oct 2014

• The general idea behind behavioural marker

systems is to provide a set of descriptors that

when identified by the instructor or trainer,

indicate effective (and in some marker systems,

ineffective) CRM behaviours.

• Hence, a key principle of the system is that

trainers are able to recognise the behaviours

consistently in the training environment.

• Many marker systems have been produced and a

variety of consistency measures have been

attempted in order to demonstrate their

consistency.

Assessment of Behavioural Skills… Flight-crew Human Factors Handbook, Oct 2014

• The University of Texas (UT) system is considered to

be the first major behaviour marker scheme and was

developed from research by Helmriech et al. in the

early days of CRM.

• It was subsequently used as the basis for many

airlines’ behaviour marker schemes (Flin and Martin

2001).

• The UT scheme splits CRM into 13 general elements,

each one being accompanied by a number of

exemplar behaviours used to assist the trainer /

examiner to identify only good CRM performance.

Assessment of Behavioural Skills… Prof. Rhona Flin, 2003

• NOTECHS

System

developed

by R Flin et

al. in 2003

Assessment of Behavioural Skills… Prof. Rhona Flin, 2003

• NOTECHS

System

developed

by R Flin et

al. in 2003

Assessing Performance: Behavioural Markers – Defined

Behavioral markers specific behaviors that serve as

indicators of how effectively crew resource management

skills are being practiced.

They are not intended to be exhaustive, but rather as good

behaviours/poor behaviour associated with effective/

ineffective crew resource management.

When considering each behavioral marker, the observer is

asked:

Was the behavior present or absent?

How critical was the behavior in the situation?

Was it effective?

How did the behavior contribute to the overall

management of the task?

Assessing Performance: Behavioural Markers – Defined

An effective behavioural marker should be:

Having a clear relationship to the competence being

assessed

Easily evaluated as a demonstration of good or poor

behaviour

Easily observable and not an attitude or personality

trait

Occurring frequently but need not be present at all

times

User-friendly for domain assessors

Positive as well as negative (for easy differentiation)

Offshore Operations: Non-technical Skill Framework

Human Factors

Social Skills

Cognitive Skills

NTS Group ~ Human Factors:

Elements of Error Handling

Human Factors

ELEMENTS of Error Handling

1. Analysing Errors

2. Mitigating Errors

3. Trapping Errors

4. Managing Failures

ELEMENTS of Communication

1. Providing information

2. Receiving information

3. Conducive body language

4. Briefings & debriefings

5. Using standard phrases

Social Skills

NTS Group ~ Social Skills:

Elements of Communication

ELEMENTS of Task Management

1. Planning

2. Prioritising

3. Distributing Workload/Resources

4. Providing & Maintaining Standards

(SOP) requirements

Cognitive Skills

NTS Group ~ Cognitive Skills:

Elements of Task Management

Elements & BMs for Category:

Communication

Elements & BMs for Category:

Teamwork

Ratings Scale for BMs:

Suggested by Klampfer et al.(2001)

Man Over Board

Exercise – Run 1

Man Over Board

Exercise – Run 2

Use of Behavioral MarkersBridge Resource Management Course

Use of Behavioral MarkersBridge Resource Management Course

Simulator Scenes @ EMAS Academy

During an Assessment Exercise

Simulator Scenes @ EMAS Academy

During an Assessment Exercise

Simulator Scenes @ EMAS Academy

During an Assessment Exercise

Simulator Scenes @ EMAS Academy

During an Assessment Exercise

Simulator Scenes @ EMAS Academy

During an Assessment Exercise

Simulator Scenes @ EMAS Academy

During an Assessment Exercise

Future of Behavioural Markers … Katherine Devitt & Capt. Simon Holford

Warsash Maritime Academy**

• BMs will enable industry to assess the

performance of the deck & engine room

teams and to improve selection, training &

promotional processes

• We have to create BMs for these purposes

and get them validated against the

framework of STCW

**Ref: Devitt et Al. (2012) - The Validation of Non-Technical Behavioural Markers

for Merchant Navy Officers

Our Publication on BRMSharing Our Experience on Soft Skill Assessment

Thank You!

Disclaimer: This material includes forward-looking statements prepared by Ezra Holdings Limited (“Company”). The opinions, forecasts, projections or other statements other than statements of historical fact, including, without limitation, estimates ofproved reserves of oil and gas, reserves potential and plans and objectives of management of the Company for financing, are forward-looking statements. Although the Company believes that the expectations reflected in such forward-lookingstatements are reasonable, it can give no assurance that such expectations will prove to have been correct. All forward looking-statements contained in this presentation are expressly qualified in their entirety by the cautionary statements contained orreferred to in this section. Readers should not place undue reliance on forward-looking statements. Each forward looking statement speaks only as of the date of this presentation. Neither the Company nor any of its subsidiaries and associatesundertake any obligation to publicly update or revise any forward-looking statement as a result of new information, future events or other information. In light of these risks, results could differ materially from those stated, implied or inferred from theforward-looking statements contained in this presentation.