managing safety in performance-based systems captain dan maurino captain dan maurino flight safety...

11
Managing Safety Managing Safety in in Performance-Based Performance-Based Systems Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance of the Worldwide Symposium on Performance of the Air Navigation System Air Navigation System Montreal Montreal 26 – 30 March 2007 26 – 30 March 2007

Upload: isaac-mccallum

Post on 27-Mar-2015

217 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Managing Safety Managing Safety in in

Performance-Based SystemsPerformance-Based Systems

Captain Dan MaurinoCaptain Dan MaurinoFlight Safety and Human Factors – ICAOFlight Safety and Human Factors – ICAO

Worldwide Symposium on Performance of the Air Navigation SystemWorldwide Symposium on Performance of the Air Navigation SystemMontrealMontreal

26 – 30 March 200726 – 30 March 2007

Page 2: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Focus on outcomes Focus on outcomes Unsafe acts at the tip of the arrowUnsafe acts at the tip of the arrowBlame & punishment for failure to “perform Blame & punishment for failure to “perform

safely”safely”Address specific safety concern exclusivelyAddress specific safety concern exclusively

Forensic Safety Management Forensic Safety Management

Page 3: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

The Underlying Paradigm–Rule-based SystemThe Underlying Paradigm–Rule-based System

Deterministic – The world as itDeterministic – The world as it should be should be Aviation system – as pre-specified – is perfectAviation system – as pre-specified – is perfect Compliance basedCompliance based Outcome orientedOutcome oriented

Accident/serious incident investigationAccident/serious incident investigation

Page 4: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Inefficiency and PerversityInefficiency and PerversityThe beatings will continue until morale improvesThe beatings will continue until morale improves

2. Punishment2. Punishment

3.3. RemedialRemedialTrainingTraining

4. Add more procedures & regulations

1. Exhortations to 1. Exhortations to professionalism professionalism and discipline and discipline

Page 5: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Operational performance

Operational performance

OperationalOperationaldeploymentdeployment

System System designdesign

Baseline performanceBaseline performance

Operationaldrift

System Performance “In the Wild”System Performance “In the Wild”

Page 6: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Managing Safety–Navigating the DriftManaging Safety–Navigating the DriftBaseline performanceBaseline performance

“Practicaldrift”

Operational

Operational performance

performance

Organization

Navigational aidsNavigational aids

ReactiveReactive ProactiveProactive PredictivePredictive

Page 7: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

The Navigational AidsThe Navigational Aids Reactive systems Reactive systems

Accident investigationAccident investigationIncident investigationIncident investigation

PredictivePredictive systemssystemsElectronic safety data Electronic safety data

acquisition systems acquisition systems Direct observation safety Direct observation safety

data acquisition systems data acquisition systems Proactive systemsProactive systems

Mandatory reporting Mandatory reporting systems systems Confidential reporting Confidential reporting systems systems VoluntaryVoluntary self-reportingself-reporting

systemssystems

Page 8: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Safety Data Systems and Levels of Intervention Safety Data Systems and Levels of Intervention

Baseline performanceBaseline performance

“Practicaldrift”

Operational performance

Operational performance organization

Predictive Proactive Reactive

Highly efficient Very efficient Efficient

Safety management levelsSafety management levels

Reactive

Desirable managementDesirable managementlevel level

Inefficient

ASRASRSurveysSurveysAuditsAudits

ASRASRMORMOR

AccidentAccidentand incidentand incident

reportsreports

HHii gghhMMiiddddllee

LLooww

HazardsHazards

FDAFDADirectDirect

observationobservationsystemssystems

Page 9: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Operational performance

Operational performance

OperationalOperationaldeploymentdeployment

System System designdesign

Baseline performanceBaseline performance

Operationaldrift

Managing Safety: Collapsing the DriftManaging Safety: Collapsing the Drift

OperationalOperationaldeploymentdeployment

System System designdesign

Operational driftOperational performance

Operational performance

Baseline performanceBaseline performance

Page 10: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Emerging Paradigm–Performance-Based SystemEmerging Paradigm–Performance-Based System

Ecological – The world Ecological – The world as it isas it is Aviation system – as pre-specified – Aviation system – as pre-specified – is imperfectis imperfect Performance basedPerformance based Process orientedProcess oriented

Safety data captured from daily, normal operationsSafety data captured from daily, normal operations

Deterministic – The world Deterministic – The world as it should beas it should be Aviation system – as pre-specified – is perfectAviation system – as pre-specified – is perfect Compliance basedCompliance based Outcome orientedOutcome oriented

Accident/serious incident investigationAccident/serious incident investigation

Page 11: Managing Safety in Performance-Based Systems Captain Dan Maurino Captain Dan Maurino Flight Safety and Human Factors – ICAO Worldwide Symposium on Performance

Performance-Based Safety: The Performance-Based Safety: The ABCABC

A.A. Senior management’s Senior management’s commitmentcommitment to the management to the management of safetyof safety

B.B. Initial analysis of system design and risk controls Initial analysis of system design and risk controls ((safety risk managementsafety risk management) )

C.C. Continuous safety monitoring and analysis of safety Continuous safety monitoring and analysis of safety data from normal operations (data from normal operations (safety assurancesafety assurance))