complimenting the emad-r process...complementing the emad-r process for non-eu recognition the pbp...
TRANSCRIPT
![Page 1: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/1.jpg)
Complementing the EMAD-R process for non-EU recognition
The PBP Bow-Tie assessment and Iris Charts
FLTLT Leon Purton Mutual Recognition Research
DGTA-ADF
Dr Kyriakos Kourousis Senior Lecturer
University of Limerick (formerly RMIT) Military Airworthiness Conference 2014 – Rome, Italy
1
![Page 2: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/2.jpg)
Context
• It was agreed at ASIC June 2013 that the EMAD-R process would be utilised by ASIC
• It was noted that the EMAD-R had a reliance on EMARs for establishing a baseline
• AU took an action to develop a method of assessing regulatory frameworks for base-lining (EMAD-R Step 5)
Military Airworthiness Conference 2014 – Rome, Italy
2
![Page 3: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/3.jpg)
Scope
• Development of an assessment methodology
• What are test points
• Representing the assessment pictorially
• Types of representation
• Some examples
• Analytical comparison
Military Airworthiness Conference 2014 – Rome, Italy
3
![Page 4: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/4.jpg)
Process • AU realised that attempting this while holding
down other duties would be difficult
• Established research position within RMIT University
• Focused on addressing this goal while assisting current recognition goals
• Assisted by intellectual rigour of academia
• Resulted in a published thesis
• Conducted a review of Western military aviation to understand requirements for diverse application
4 Military Airworthiness Conference 2014 – Rome, Italy
![Page 5: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/5.jpg)
The PBP Bow-Tie – Technical Integrity
5
Loss of Technical Integrity
Thre
at t
o
Effe
ct o
f
Behavioural Integrity Behavioural Integrity
Good Product, Good People, Good Processes
Military Airworthiness Conference 2014 – Rome, Italy
![Page 6: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/6.jpg)
The PBP Bow-Tie – Technical Lifecycle
6
Design Produce Maintain
Supply
Management
Technical Item Lifecycle
Military Airworthiness Conference 2014 – Rome, Italy
![Page 7: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/7.jpg)
The PBP Bow-Tie – Making an Attestation
7 Military Airworthiness Conference 2014 – Rome, Italy
![Page 8: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/8.jpg)
8
The PBP Bow-Tie – Overlaying the concepts
![Page 9: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/9.jpg)
9
![Page 10: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/10.jpg)
Identifying Regulator Interaction
10
Key to visualising regulatory framework
Military Airworthiness Conference 2014 – Rome, Italy
![Page 11: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/11.jpg)
![Page 12: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/12.jpg)
Examples - representation
12
Product
Behaviour
Process
ADF Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
Process
EASA Bow-Tie Assessment
Main
tenan
ce
Military Airworthiness Conference 2014 – Rome, Italy
![Page 13: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/13.jpg)
Examples – internal comparison
13 Military Airworthiness Conference 2014 – Rome, Italy
![Page 14: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/14.jpg)
Examples – External comparison
4th Meeting of the ASIC Airworthiness Working Group – San Diego 25-27 Feb 14 14
![Page 15: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/15.jpg)
ASIC Nations
• I have assessed the seven service organisations within the five Nations.
• Detailed analysis based on Iris Chart visualisations of ADF comparison with:
• NZDF
• US Army
• US Navy
• Used to complement recognition activities
15 Military Airworthiness Conference 2014 – Rome, Italy
![Page 16: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/16.jpg)
ADF and NZDF
16
NZD
F AD
F Design Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE
![Page 17: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/17.jpg)
Example test point comparison
4th Meeting of the ASIC Airworthiness Working Group – San Diego 25-27 Feb 14 17
![Page 18: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/18.jpg)
NZD
F AD
F Design
Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE INDUSTRY
![Page 19: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/19.jpg)
ADF and US Army
19
US
Arm
y AD
F Design Design
Production Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENSE
![Page 20: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/20.jpg)
US
Arm
y AD
F Design Design
Production Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENSE INDUSTRY
![Page 21: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/21.jpg)
ADF and US Navy
21
AD
F Design Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE U
SN
![Page 22: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/22.jpg)
AD
F Design
Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE INDUSTRY
USN
![Page 23: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/23.jpg)
The ASIC Nations
23
Product
Behaviour
Process
ADF Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
Process
UK MAA Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
Process
US Army Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
US Navy Bow-Tie Assessment
Main
tenan
ce
Process
(b) (d)
(e)
(a)
(c)
Product
Behaviour
Process
NZDF Bow-Tie Assessment
Main
tenan
ce
![Page 24: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/24.jpg)
Summary • While the assessment is presented on a Bow-Tie,
it really defaults to a Layer of Protection Analysis since the right-hand side does not really translate
• It does, however, provide a powerful communication and discussion tool offering numerous methods of comparison
• Its use will be adopted into an ASIC AIR STD detailing how to complement ASIC recognition using EMAD-R
• It can be used/adapted in many different scenarios, as the same principles apply
24
![Page 25: Complimenting the EMAD-R process...Complementing the EMAD-R process for non-EU recognition The PBP Bow-Tie assessment and Iris Charts FLTLT Leon Purton Mutual Recognition Research](https://reader031.vdocuments.us/reader031/viewer/2022040601/5e93982049207d13be7be212/html5/thumbnails/25.jpg)
Questions
25
PAPER 1 Purton, L. and K. Kourousis, Military airworthiness management frameworks: a critical review. Procedia Engineering, article in press.
PAPER 2 Purton, L., R. Clothier, and K. Kourousis, Assessment of Technical Airworthiness in Military Aviation: Implementation and Further advancement of the Bow-Tie Model. Procedia Engineering, article in press.
PAPER 3 Purton, L., et al., Mutual Recognition of National Military Airworthiness Authorities: A Streamlined Assessment Process. International Journal of Aeronautics and Space Sciences, http://ijass.org/PublishedPaper/topic_abstract.asp?idx=436
PAPER 4 Purton, L., et al., The PBP Bow-Tie Framework for the Systematic Representation and Comparison of Safety Regulatory Frameworks. RAeS Aeronautical Journal, article in press.