SUBSAFEand the

NASA / Navy Benchmarking Exchange

CAPT(s) S. E. Iwanowicz, USNDirector of Submarine Safety & Quality Assurance

Naval Sea Systems Command

2

Agenda

1. Origins of SUBSAFE

2. Program Overview

3. Origins of the NASA / Navy Benchmarking Exchange Program

4. Questions

1. Origins1. Origins

4

USS THRESHER (SSN-593) was launched in 1960.

• The first ship of her class – the leading edge of US submarine technology:

• combining nuclear power with a modern hull design;

• including many newly-designed components and equipment.

She was fast, quiet, and deep diving

5

April 10, 1963:

While engaged in a deep test dive approximately 200 miles off the northeast coast of the

United States,

THRESHER was lost at sea with all aboard

112 Officers and Enlisted;17 civilians

died

6

USS THRESHER Investigations

• Court of Inquiry• Design Appraisal Board• Congressional Committee Hearings

–Focus:»Design»Construction»Operation

7

Investigation Results“… too far, too fast…”

• Deficient Specifications

• Deficient Shipbuilding and Maintenance Practices

• Incomplete or Non-Existent Records– Work Accomplished– Critical Materials– Critical Processes

• Deficient Operational Procedures

8

Investigation Conclusions

• Catastrophic Flooding in the Engine Room– Unable to secure from flooding– Salt water spray on electrical switchboards– Loss of propulsion power

• Unable to blow Main Ballast Tanks

9

Inception of SUBSAFE

• “the 20 December 1963 Letter” established Submarine Safety Certification Criterion

• Defined the basic foundation and structure of the program that is still in place today:– Design Requirements– Initial SUBSAFE Certification Requirements &

Process– Certification Continuity Requirements and Process

10

Purpose & Focus

• The purpose of the SUBSAFE Program is to provide “maximum reasonable assurance” of:

– Hull integrity to preclude flooding

– Operability and integrity of critical systems and components to control and recover from a flooding casualty

11

“Maximum Reasonable Assurance”

Achieved by:

– Initial SUBSAFE Certification • Each submarine meets SUBSAFE requirements upon

delivery to the Navy

– Maintaining SUBSAFE Certification • Required throughout the life of the submarine

The SUBSAFE Certification status of a submarine is fundamental to its mission capability

12

Establishing & Maintaining SUBSAFE Certification

The Triad:– Audits– Re-Entry Control– URO/MRC Program

All atop a • Base of SUBSAFE Technical Requirements

• Maximum reasonable assurance is achieved through establishing the initial certification and then by maintaining it through the life of the submarine

13

SUBSAFE Program Success1915 – 1963

16 submarines lost to non-combat causes

1915: USS F-4 (SS-23)1917: USS F-4 (SS-20)1920: USS H-1 (SS-28)

USS S-5 (SS-110)1923: USS O-5 (SS-66)1926: USS S-51 (SS-162)1927: USS S-4 (SS-109)1939: USS SQUALUS (SS-192)1941: USS O-9 (SS-70)1942: USS S-26 (SS-131)

USS R-19 (SS-96)1943: USS R-12 (SS-89)1944: USS S-28 (SS-133)1949: USS COCHINO (SS-345)1958: USS STICKLEBACK (SS-415)1963: USS THRESHER (SSN-593)

1963 - Present1 submarine lost to non-combat causes

1968: USS SCORPION (SSN-598)• SCORPION was not SUBSAFE

certified• Loss would not have been

prevented by the SUBSAFE Program

SUBSAFE Program inception after THRESHER was lost

NO SUBSAFE-CERTIFIED SUBMARINE HAS EVER BEEN LOST

Video

The THRESHER Disaster

2. SUBSAFE Overview2. SUBSAFE Overview

“trust, but verify…”“trust, but verify…”

16

SUBSAFE Culture

• The SUBSAFE Program provides:– a thorough and systematic approach to quality– a philosophy and an attitude that permeates the entire

submarine community

• SUBSAFE Technical Requirements:– applied at design inception– carried through to purchasing, material receipt, and

assembly / installation– examined & included at the component level, the system

level, the interactions between systems, and aggregate effects (DFSs)

– included in maintenance / modernization and operating parameters

17

SUBSAFE Culture

• Work Discipline– Knowledge / Training– Compliance

• Material Control– Correct Material Installed Correctly

• Documentation– Design Products– Objective Quality Evidence (OQE)

18

LOK &Training

• Provides an overview of the SUBSAFE program.

• Covers deficiencies and trends encountered throughout the previous years.

• Discusses the necessity to avoid complacency in your job and how to effectively implement long-term corrective and preventive actions to resolve problems.

Annual NAVSEA SUBSAFE Training

19

LOK & Training

• Activity-specific training plans are established to concentrate on areas that require additional attention.

• Activity-specific training plans are reviewed for compliance during Functional Audits.

• LOK assessments are performed during Functional Audits

Activity Based Training

20

Material Control & Documentation

• Certification is strictly based on OQE

– OQE is any statement of fact pertaining to the quality of a product or service based on observations, measurements, or tests which can be verified.

• either quantitative or qualitative• OQE is defined from technical requirements• Based on the integrity & responsibility of individuals

– OQE provides verifiable evidence that deliberate steps were taken to comply with requirements

Objective Quality Evidence

21

Trust, but Verify

• SUBSAFE Certification Audits review the Objective Quality Evidence associated with an individual ship to ensure that the material condition of that specific submarine is satisfactory for sea trial and unrestricted operations

• SUBSAFE Functional Audits review the policies, procedures, and practices used by activities to perform SUBSAFE work to ensure that they comply with SUBSAFE requirements

SUBSAFE Audits

22

Vertical Audits & Horizontal Audits

• Vertical Audit– An intensive examination of the documentation that was

used to SUBSAFE certify components from receipt through final installation.

• Horizontal Audit: the parts equaling the whole– In SUBSAFE Certification Audits specific areas of the

SUBSAFE boundary are audited. • Examples are, Hull Structure, Piping, Testing, Configuration

Management, etc. • The results of auditing these specific areas provides an overall

picture of the work performed on a specific hull.

23

SUBSAFE Culture

• The SUBSAFE program relies upon recruiting, training, and retaining highly qualified people who are held personally accountable and responsible for safety

• In the SUBSAFE program, complacency is addressed by:– Performing periodic rigorous audits of all SUBSAFE Activities & Products

– Maintaining command level visibility

– Maintaining the independent authority of the SUBSAFE Program Director – accountable for safety, not cost or schedule

24

Main Points

• The SUBSAFE Program permeates all levels of the submarine community: the Fleet, shipbuilders, maintenance providers, NAVSEA, Operational Commanders, etc.

– They believe in it and understand it.

• Oversight and enforcement of Program tenets are vital to continued success

– The entire program is based on personal responsibility & personal accountability - without it, you are lost

– Compliance verification & OQE are fundamental to certification for URO– Talented dedicated people & good training are key– Vigilance, vigilance, vigilance – FIGHT COMPLACENCY– The more complex a system, the more assurance you need– Team effort & x-pollination pay big dividends

• Continual assaults on the Program from real-world constraints– The real challenge is to properly manage the non-conformances

3. Origins of the NASA / Navy Benchmarking Exchange

Program

26

NNBE Beginnings

• NASA/Navy Benchmarking Exchange (NNBE) initiated by NASA Administrator letter to Secretary of the Navy dated 13 Jun 02

• Purpose: – identify practices and procedures and share lessons learned in

NASA’s human space flight program and the Navy’s submarine program

• Focus: – safety and mission assurance policies, processes, accountability,

and control measures

27

Similarities

• Extreme environments• High energy systems• Required integration of complex systems in highly

complex vehicles.• Highest levels of safety & reliability must be maintained

for craft to perform their missions, often over long periods of time.

• Design, testing, operation, and maintenance of the craft require firm technical basis and compliance verification.

• Critical systems exist whose failure or lack of operation will have catastrophic consequences.

28

Differences

• Operating environments• Cultural environments• Degrees of reliance on evolution and legacy of design• Weight and volume criticalities• Safety and mission assurance requirements

management• Verification and compliance approaches

29

NNBE Audits & Projects Program

MOA signed 15 Feb 05

• Reciprocal rights to participate in audits & projects – Conducted at the invitation of the party of the program or

project– Provides a learning opportunity for each party

30

MOA between NAVSEA and NASA

• Responsibilities:

– NAVSEA to provide opportunity for NASA participation in audits

• Provide read ahead material, on-site space, establish number of participants

– NASA to provide opportunities for Navy participation in review and assessment of

• NASA Engineering and QA audits• Headquarters-led institutional and programmatic audits

• MOA reviewed every two years for the purpose of • Reaffirming organizational commitment• Share lessons learned to strengthen each others audit

objectives

31

NNBE Scope

• NNBE team to closely examined two aspects of submarine safety– New design / construction (initial certification)– Maintenance & Modernization (sustaining certification)

• Major Themes– Management & Organization – Safety Requirements (technical and administrative)– Safety Implementation Processes– Safety Compliance Verification Processes– Safety Certification Processes

32

Phase 1 NASA learns about the Navy

• NAVSEA HQ– NAVSEA 08 Brief

(1 Oct 02)– SUBSAFE Working

Group (17 Sept 02)– PMS450– NAVSEA 05– PMS392

• SUPSHIP GROTON SSFA (23 Sept 02)

• EB CORP (16 Oct 02)• PNSY (21Oct 02)• SUBMEPP (22 Oct 02)• SHAPEC (23 Oct 02)• NAVSEALOGCEN

(23 Oct 02)

Visits & activities coordinated by NAVSEA 07Q:

33

Key Observations of SUBSAFE Processes

• Excerpts from NNBE reports:

– Clearly documented and achievable safety requirements, with minimal use of waivers or tailoring

– A centralized technical authority and a large operational experience base facilitate continuous learning and improvement in design, manufacturing, and operations.

• Enables evolutionary design (from one ship class to next)

– Requirements implemented through capable and carefully controlled processes

34

Key Observations of SUBSAFE Processes

– Compliance is verified through rigorous in-line management control and assurance processes

– Compliance is also verified independently of program management by a separate compliance verification organization

– Strong submarine community-wide safety culture with emphasis (training & awareness) on understanding and learning from past failures

35

Phase 2 Navy learns about NASA

Visits coordinated by NASA office of Safety & Mission Assurance:

• NASA HQ (5 Nov 02)• Johnson Space Center (JSC-1) (5 Nov 02)• Kennedy Space Center (KSC-1) (7 Jan 03)

• Observed Flight Readiness Review for COLUMBIA launch (9 Jan 03)

36

The bitterness of poor quality lingers long after the sweetness

of meeting a schedule is forgotten

4. Questions4. Questions