system of systems engineering pilot quality function … · 2017. 5. 19. · 1 asw sos systems...

23
1 ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot QFD Analysis QFD Analysis 10 10 th th Annual Systems Engineering Conference Annual Systems Engineering Conference Session Session - - T&E in Systems Engineering T&E in Systems Engineering System of Systems Engineering Pilot System of Systems Engineering Pilot Quality Function Deployment Analysis Quality Function Deployment Analysis 10 10 th th Annual Systems Engineering Conference Annual Systems Engineering Conference 22 22 - - 25 October, 2007 25 October, 2007 Paper No. 5602 Paper No. 5602 G. R. Thompson G. R. Thompson [email protected] [email protected] 240 240 - - 228 228 - - 5396 5396 Co Co - - Contributors: Contributors: Jack Price, Strategic Insight Jack Price, Strategic Insight ASN/RDA CHSENG ASN/RDA CHSENG Dr. Harry Crisp, Strategic Insight Dr. Harry Crisp, Strategic Insight - - ASN/RDA CHSENG ASN/RDA CHSENG Richard Schmidt, ASN/RDA CHSENG Richard Schmidt, ASN/RDA CHSENG Janet Spedden, JHU/APL Janet Spedden, JHU/APL Angie Milano, JHU/APL Angie Milano, JHU/APL ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot QFD Analysis QFD Analysis 10 10 th th Annual Systems Engineering Conference Annual Systems Engineering Conference Session Session - - T&E in Systems Engineering T&E in Systems Engineering Distribution Statement A Approved for Public Release; Distribution is Unlimited Version dated 10/12/07

Upload: others

Post on 16-Aug-2020

1 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

1

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

System of Systems Engineering PilotSystem of Systems Engineering PilotQuality Function Deployment AnalysisQuality Function Deployment Analysis

1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference2222--25 October, 200725 October, 2007

Paper No. 5602Paper No. 5602G. R. ThompsonG. R. Thompson

[email protected]@jhuapl.edu240240--228228--53965396

CoCo--Contributors:Contributors:Jack Price, Strategic Insight Jack Price, Strategic Insight –– ASN/RDA CHSENG ASN/RDA CHSENG

Dr. Harry Crisp, Strategic InsightDr. Harry Crisp, Strategic Insight-- ASN/RDA CHSENGASN/RDA CHSENGRichard Schmidt, ASN/RDA CHSENGRichard Schmidt, ASN/RDA CHSENG

Janet Spedden, JHU/APLJanet Spedden, JHU/APLAngie Milano, JHU/APLAngie Milano, JHU/APL

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Distribution Statement AApproved for Public Release;

Distribution is Unlimited

Version dated 10/12/07

Page 2: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

2

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

IntroductionIntroduction

• SoS Systems Engineering project addressing LCS ASW Integration & Mission Capability Evolution

• Pilot project conducted by ASW Systems Engineering Team (ASSET) chaired by PEO-IWS5 SE

• Application of ASN/RDA CHSENG Naval SoS SE Guidelines

• Employed Quality Function Deployment (QFD) for SoScapability evaluation

Page 3: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

3

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

LCS ASW SoS Pilot Project

Quiet Diesel Submarine Threat

LCS Platform Concepts

• Proliferation of quiet diesel submarines creates a growing ASW challenge• ASW inherently a “system-of-systems” enterprise:

• Platforms• Sensors• Weapons• Command, Control & Communications

• Littoral Combat Ship (LCS) a “transformational” concept:

• Agile platform• Reconfigurable mission packages• Extensive use of unmanned vehicles & off-board sensors• Spiral development

• Pilot project objectives• Address needed ASW capability• Apply ASN/RDA SoS SE guidelines

- Including QFD • Show “value added” in SoS acquisition

Page 4: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

4

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

ASW System of Systems Engineering Process

Connotes SoS SE Steps

ASWCapability

nAcquisitionPrograms

ASW ICD ASW

Capability n

ASW Capability

2

ASWCapability

1

ASW (FoS) CapabilityPlanning

SoSAcquisition

PortfolioExecution

SynchronizedDelivery of

ASW Capabilities

System PerformanceDocument (SPD)•SoS PerformanceRequirements•SoS Functional Architecture•SoS Physical Architecture•SoS T&E Requirements

ASW Capability

2AcquisitionPrograms

ASWCapability

1 AcquisitionPrograms

•ASW Capabilities & Objectives•ASW Architecture Development/Mgt•ASW Portfolio ID•ASW Portfolio Roadmap

Capability Evolution Plan (CEP)•Pilot CONOPS•Force Package Structure•Quality Function Deployment (QFD)•System Acquisition Roadmap•SoS Capability Assessment

SoS CapabilityPlanning

SoS Capability Engineering

Pilot Assessment

•AOAs•CDDs•CPDs•NR-KPPsJCIDS

Acquisition

Page 5: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

5

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

LCS ASW Mission Context

ASW CONOPs, Capabilities, & Gaps(ICD)

ASW CONOPs, Capabilities, & Gaps(ICD)

ASW Operations (ASW Wide)

ASW Operations (ASW Wide)

Offensive ASW(Barrier Mission) Offensive ASW

(Barrier Mission)

LCS ASW Mission PackageIntegration

(Force Package / Portfolio)

LCS ASW Mission PackageIntegration

(Force Package / Portfolio)

ASWMission

Capability Architectures

ASWMission

Capability Architectures

Pilot Alignment

Off. ASW …

SystemPerformance

Document (SPD)

SystemPerformance

Document (SPD)

Capability EvolutionPlan (CEP)

Capability EvolutionPlan (CEP)

SoS SE Elements

CapabilityAssessment

(QFD)

CapabilityAssessment

(QFD)

Page 6: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

6

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

LCS Pilot Project PortfolioOffensive ASW Capability

(Barrier Mission)Offensive ASW Capability

(Barrier Mission)

Other TacticalAssets

LCS(Platform A/B)

Spiral A ASWMission Package

Spiral B ASWMission Package

ASW Modules&

Systems (Defined)

ASW Modules&

Systems (TBD)

Other Activities

C4ISR/Net

CUP/COP

Mission Plan.

Remote Processing

Force Package

Collaborative Operations

Logistics

SubAir

SurfSurv (Fixed & Mobile)

Page 7: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

7

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Capability

Objectives

Capability

MOEs

Force Package Structure

Mission

Threads

Platform/FacilityNodes

Systems,Applications& Personnel

SystemInterfaces,

MMI

SystemKPPs

OperationalActivities/

Tasks

InformationExchange

FunctionalData Flow

FunctionalProcesses

SystemInterfaces,

MMI

Interop.-

KPPs

FunctionalProcesses

Systems,Applications& Personnel

OperationalActivities/

Tasks

1

2

6a

4

3b

8a

7a

5a

6c

6b

5b

8b

7b

3aAV-1

AV-1

OV-5

SV-1

SV-2

SV-3, 10c

SV-7

SV-7

Mission

ThreadsOV-6c

OV-3

SV-6

SV-5a

SV-5b, 10c

SV-4a

SV-6

SystemMOPs

SV-7’

CAPABILITY ALIGNMENTASSESSMENT

INTEROPERABILITY ASSESSMENT

CAPABILITY PERFORMANCE ASSESSMENT

FUNCTIONAL ALLOCATION ASSESSMENT

8c

LCS PilotMatrix 1

LCS PilotMatrix 2

Commercial/DoD QFD Examples

QFD Matrices for Capability-Based Planning

Naval SoS SE Guidebook QFD Process(and DODAF Relationships)

Page 8: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

8

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Pilot QFD Matrices & Workshop

Matrix 1

Ope

ratio

nal S

tage

san

d A

ctiv

ities

SoS Functions & Systems

Importance Score

Operational Priority and Functional & System

Importance

Matrix 2

SoS

Syst

em F

unct

ions

&

Sys

tem

s

SoS Capability Metrics

Capability Score

Functional CapabilityAssessment

Workshop Day 1 Workshop Day 2

CriticalFunctions

Mission &SoS Systems

MCA

SoS Capability“Gaps”

(CEP Focus)

Operational &Engineering Metrics(ICD, CDD, Other)

• 2-Day Workshop• ~30 Subject Matter Experts (SME)• Divided into four teams• Operational, technical, engineering expertise

• 2-Day Workshop• ~30 Subject Matter Experts (SME)• Divided into four teams• Operational, technical, engineering expertise

Page 9: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

9

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Matrix 1 (partial)Operational Activity & System Functions

Operational Activities

LCS Pilot SoS System and Functions

Operational Stage

Platform / Vehicle

System

1.1.1.4 MAD, Radar, EO

(Helo Dependent)

ID F1.1.1.1.1 F1.1.1.1.2 F1.1.1.1.3 F1.1.1.1.4 F1.1.1.2.1 F1.1.1.2.2 F1.1.1.2.3 F1.1.1.2.4 F1.1.1.3.1 F1.1.1.3.2 F1.1.1.3.3 F1.1.1.3.4 F1.1.1.3.5 F1.1.1.4.1 F1.1.1.5.1 F1.1.1.5.2 F1.1.1.5.3 F1.1.1.5.4

Stage Stage Score ID Activity Stage Score Allocations Functions: Flight operations Communicate Sensor

Processing Navigation Deploy Sense Localize Onboard Processing Deploy Sense Localize Onboard

Processing Communicate DCL Deploy / Placement Search Acquire

Target Kill

A.1 Retrieve MP from Stowage

A.2Module configuration and checkout

A.3Transport

A.4 Onload modules and mission crew

B.1 Assign Mission

B.2Plan ASW mission

B.3Underway and Transit

B.4 Arrive at assigned operating area

B.5Establish theater tactical communications (OPCON and TACON)

B.6Coordinate with other assets

C.1 Arrive OPAREA

C.2 Characterize/measure area environment

C.3 Mission/Sensor employment planning

C.4Final vehicle/sensor reconfiguration and checkout

C.5Launch vehicles/OOV's

C.6 Check operability

C.7 Return to patrol station

C.8Operate and monitor OOV's

A.

Stor

age

B.

Dep

loym

ent

C.

Inst

alla

tion

1.1.1.1 Helo (SH-60B, MH-60R) 1.1.1.5 Weapons (Mk46, MK54)1.1.1.2 ALFS (Dipping Sonar) (MH60R Only) 1.1.1.3 Sonobuoy (Family)

1.1.1 Helicopter

0

0

0

Metric Score 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Step 3: Compute overall Importance Score

Step 2: Score in terms of criticality of function to operational activity(scale: 9-6-3-1, 0)

Step 1: Allocation of 1000 points across stages and activities

AdditionalMatrixRows & ColumnsImportance score = Σ (Activity value X criticality value per cell)

Func

tion

Impo

rtan

ce

Page 10: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

10

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Stage Score Allocations (Matrix 1)

0

50

100

150

200

250

300

350

400

450

Storage Deployment Installation Execution Self-Defense Mission Sustain. &Post-Mission OPS

Stages

Scor

es (f

ract

ion

of 1

000)

Team prioritization of operational the six stages(Allocation of 1000 points)

Matrix 1 (Day 1)

Ope

ratio

nal S

tage

san

d Ac

tiviti

es

SoS Functions & Systems

Importance Score

Operational Priority and Functional & System

Importance

Team Scores

Team Average

Page 11: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

11

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Operational Activity Priority – Execution StageRank Ordered Team Averages

(Allocation of points assigned to Execution Stage)

Matrix 1 (Day 1)

HigherPriority

Ope

ratio

nal S

tage

san

d Ac

tiviti

es

SoS Functions & Systems

Importance Score

Operational Priority and Functional & System

Importance

0 10 20 30 40 50 60 70

D.10

D.2

D.5

D.14

D.3

D.15

D.8

D.12

D.1

D.9

D.11

D.4

D.7

D.13

D.6

Ope

ratio

nal

Act

iviti

es (I

D)

Score (Team Average)

LowerPriority

Page 12: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

12

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

0

500

1000

1500

2000

2500

3000

F2.1.

1.2.3

F1.6.1.

3F4.1

.2.1.1

F1.1.1.

1.1F1

.3.1.1

/2.4

F1.3.

1.1/2.

2F1.4

.1.1

F2.1.

1.5.3

F1.1.

1.3.2

F1.3.

1.1/2.

6F2.1

.1.4.3

F1.1.1.

3.4F1

.1.1.2

.1F1

.1.1.3

.5F1

.1.1.2

.4F1

.4.1.6

F1.1.1.

5.1F1.1

.1.5.4

F4.1.1.

3.2F1

.1.1.4

.1F1

.2.1/2

.3F2

.1.1.5

.4F4.1

.1.4.1

F2.1.1.

3.2F1.5

.1.1.3

F1.5.

1.1.1

F1.5.

1.1.7

F2.1.

1.6.2

F3.1.1.

1.2

Impo

rtan

ce S

core

Function Importance (Execution Stage/Matrix 1) Team Score Averages (Ranked)

Importance = ΣActivity Score X Rated Functional Criticality

Top Rated Functions(Importance > 1000)

Matrix 1 (Day 1)

Ope

ratio

nal S

tage

san

d Ac

tiviti

es

SoS Functions & Systems

Importance Score

Operational Priority and Functional & System

Importance

System Functions (ID)

Page 13: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

13

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

System Importance (Matrix 1) Execution Stage

Ranked Team Averages

Matrix 1 (Day 1)

Ope

ratio

nal S

tage

san

d Ac

tiviti

es

SoS Functions & Systems

Importance Score

Operational Priority and Functional & System

Importance

0

1000

2000

3000

4000

5000

6000

7000

1.6.1.

1

1.3.1.

1 / 1

.3.1.2

1.4

.1.

2.1.1.

21.1

.1.1

1.2.1.

1 / 1.

2.1.2

1.1.1.

31.1

.1.2

1.1.1.

5 4.1

.1.2

2.1.1.

4 1.6

.1.2

2.1.1.

5 4.1

.1.3

3.1.1.

1 4.1

.2.1

4.1.2.

2 4.1

.1.4

4.1.2.

3 1.5

.1.1

4.1.2.

4 4.1

.1.1

1.1.1.

4 2.1

.1.1

2.1.1.

31.6

.1.3

3.1.1.

2 2.1

.1.6

Systems (ID)

Ave

rage

Impo

rtan

ce S

core

Aggregated function scores of each system that had one or more rated functions

Page 14: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

14

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Matrix 2 (partial)System/Functions vs Capability

Global Metric

ID M1.1.1 M1.1.2 M1.1.3 M1.1.4 M1.1.5 M1.1.6 M1.2.1 M1.2.2 M1.2.3 M1.2.4 M1.2.5 M1.2.6

Metric Search Rate/Coverage Detect/Class Track False Contact

Rate

LCS Mission Sustainment

(days)

Area Environmental Understanding

Redetect & Class Localize Engage Kill

Asset Availability/Respo

nsiveness

Weapon Availability

Functional Component Platform / Vehicle System ID Functions: Metric Score (from

Matrix #1)

F1.1.1.1.1 Flight operations 0F1.1.1.1.2 Communicate 0F1.1.1.1.3 Sensor Processing 0F1.1.1.1.4 Navigation 0F1.1.1.2.1 Deploy 0F1.1.1.2.2 Sense 0F1.1.1.2.3 Localize 0F1.1.1.2.4 Onboard Processing 0F1.1.1.3.1 Deploy 0F1.1.1.3.2 Sense 0F1.1.1.3.3 Localize 0F1.1.1.3.4 Onboard Processing 0F1.1.1.3.5 Communicate 0

1.1.1.4 MAD, Radar, EO (Helo Dependent)

F1.1.1.4.1 Detect/Classify/Localize 0F1.1.1.5.1 Deploy / Placement 0F1.1.1.5.2 Search 0F1.1.1.5.3 Acquire Target 0F1.1.1.5.4 Kill 0F1.2.1/2.1 Operate & Control 0F1.2.1/2.2 Sense 0F1.2.1/2.3 Localize / Track 0F1.2.1/2.4 Communicate 0F1.2.1/2.5 Onboard Processing 0F1.2.1/2.6 Navigate 0

F1.3.1.1/2.1 Operate & Control 0F1.3.1.1/2.2 Sense 0F1.3.1.1/2.3 Localize / Track 0F1.3.1.1/2.4 Communicate 0F1.3.1.1/2.5 Status / Diagnostics 0F1.3.1.1/2.6 Navigate 0

F1.4.1.1 Operate & Control 0F1.4.1.2 Sense 0F1.4.1.3 Localize / track 0F1.4.1.4 Communicate 0F1.4.1.5 Navigate 0F1.4.1.6 Onboard Processing 0

M1.1 ASW Search M1.2 Kill Chain Metrics

1.1.1.5 Weapons (Mk46, MK54)

1.2 Mid-Frequency

Bistatic Mission module

1.2.1 RMV(2) 1.2.1.1 RTA / 1.2.1.2 RTAS

1.1 Aviation Mission Module 1.1.1 Helicopter

1.1.1.1 Helo (SH-60B, MH-60R)

1.1.1.2 ALFS (Dipping Sonar) (MH60R Only)

1.1.1.3 Sonobuoy (Family)

1.3 LF Bistatic Mission Module

1.3.1/ 1.4.1 USV(2)

1.3.1.1 UTAS / 1.3.1.2 MSOBS

1.4 Mid-Frequency Monostatic

Mission Module

1.4.1. UDS

System and Functions (from Matrix 1)

Step 3: Compile overall capability scores

Step 2: Score in terms of capability (fully capable to significantly incapable)

Step 1: Address higher important functions and systems from Matrix 1

AdditionalMatrixRows & Columns

Capability Metrics (by Category)

Score0 0 0 0 0 0 0 0 0 0 0 0

Score = Σ (system function score X adequacy rating value per cell)

Matrix 2 (Day 2)

SoS

Syst

em F

unct

ions

&

Sys

tem

s

SoS Capability Metrics

Capability Score

Functional CapabilityScoring

Ove

rall

Cap

abili

ty S

core

System Capability Score

Page 15: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

15

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Capability Scores(Execution Stage)

Score < 6 considered a Capability “gap”

0

1

2

3

4

5

6

7

8

9

Search Rat e/Coverage Det ect / Class Track False Cont act Rat e LCS Mission Sust ainment (days) Area Environment al Underst anding0

1

2

3

4

5

6

7

8

9

Redetect & Class Localize Kill Engage Weapon Availability AssetAvailability/Responsiveness

Nor

mal

ized

Ave

rage

Cap

abili

ty S

core

0

1

2

3

4

5

6

7

8

9

Technical Maturity or Risk Deploy/Recovery Feasibility Operating Range from Ship Operating Endurance Cycle Time

Nor

mal

ized

Ave

rage

Cap

abilt

iy S

core

0

1

2

3

4

5

6

7

8

9

Logistics & Readiness Interoperability Flexibility & Adaptibility Communication Robustness

Nor

mal

ized

Ave

rage

Cap

abili

ty S

core

Interoperability & Support

Search Engagement

DeploymentFully

Capable

Completely Inadequate

ModeratelyCapable

FullyCapable

Completely Inadequate

ModeratelyCapable

ModeratelyInadequate

ModeratelyInadequate

Matrix 2 (Day 2)

SoS

Syst

em F

unct

ions

&

Sys

tem

s

SoS Capability Metrics

Capability Score

Functional CapabilityScoring

CapabilitiesCapabilities

CapabilitiesCapabilities

Page 16: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

16

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

System Capability vs. Importance(Results of Matrix 1 & 2)

0

1

2

3

4

5

6

7

8

9

0 1000 2000 3000 4000 5000 6000 7000

System Importance Score (Matrix 1)

Syst

em C

apab

ility

Sco

re (M

atrix

2

(Based on Execution Stage evaluation)

Less Important/Capable

Less Important/Less Capable

Important/Capable

Important/ Less Capable

Page 17: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

17

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

QFD Workshop Comments• Carefully constructed matrices critical to success

• Manageable matrix size (dimensions)

• A two-day workshop was insufficient

• Dividing participants into four smaller working groups worked well.

• Need clear Concept of Operations and mission threads (ideally anapproved set of architectures)

• Description and performance information regarding the systems being rated needed on site

• An experienced QFD workshop facilitator if not facility recommended

Page 18: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

18

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Summary

• LCS ASW Integration Pilot project has been a good example of SoS SE process– Portfolio of systems– Application of the ASN/RDA SoS SE Guidelines

• The QFD process was adapted from the SoS SE Guide and other QFD applications and was effective in identifying functional priorities and capability gaps across a complex SoS portfolio.

• QFD matrices must be customized to assess the operational, functional, and physical aspects of the Force Package.

• The matrices map to or expand upon the DOD Architecture Framework and thereby are a further use of the architecture products

• The process followed is considered useful, applicable, and adaptable to other SoS capability evolution scenarios.

Page 19: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

19

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Backups

Page 20: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

20

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

LCS Operational Stages and Activities (Matrix 1)

*Ref: LCS ASW Mission Package Overview,PMS 420

**Ref: LCS Operational Assessment Scenario, SPA and other sources

Module configuration and checkoutTransportOnload modules and mission crewSt

orag

e

Plan ASW missionUnderway and TransitArrive at assigned operating area

Establish theater tactical communications (OPCON and TACON)Coordinate with other assets

Dep

loym

ent:

Characterize/measure area environment Mission/Sensor employment planningFinal vehicle/sensor reconfiguration and checkout

Launch vehicles/OOV's Check operabilityReturn to patrol stationOperate and monitor OOV's

Inst

alla

tion

Conduct area searchDetect and classify contactsResolve possible false contactsReport detections to Sqn and ASWCLocalize, track and monitor threat submarinesTarget reported to sqn and ASWCProsecution assets proceed to targetProsecution assets redetects, classifies and localizes targetProsecution assets request and receives attack authorizationProsection assets launches weaponAttack assessmentReattack if requiredProsecution assets return to LCs or patrol stationHandoff/receive targets with other assets Maintain tactical Picture

Exec

utio

n

Threat /Weapons DCL

Evade

Self-

Def

ense

Refurbish and Redeploy OOV'sLCS proceeds to sensor station

Final recovery of OOV'sConducts turnover with relieving LCSOnboard stowage

Transit to port (or ship replenishment sight)Off-loadRefurbishmentStowage

Mis

sion

Sus

tain

men

t & P

ost-

Mis

sion

OPS

Activity ActivityActivity

Page 21: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

21

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

1.1.1.4 MAD, Radar, EO

(Helo Dependent)

F1.1.1.1.1 F1.1.1.1.2 F1.1.1.1.3 F1.1.1.1.4 F1.1.1.2.1 F1.1.1.2.2 F1.1.1.2.3 F1.1.1.2.4 F1.1.1.3.1 F1.1.1.3.2 F1.1.1.3.3 F1.1.1.3.4 F1.1.1.3.5 F1.1.1.4.1 F1.1.1.5.1 F1.1.1.5.2 F1.1.1.5.3 F1.1.1.5.4

Flight operations Communicate Sensor

Processing Navigation Deploy Sense Localize Onboard Processing Deploy Sense Localize Onboard

Processing Communicate DCL Deploy / Placement Search Acquire

Target Kill

1.1.1.1 Helo (SH-60B, MH-60R) 1.1.1.5 Weapons (Mk46, MK54)1.1.1.2 ALFS (Dipping Sonar) (MH60R Only) 1.1.1.3 Sonobuoy (Family)

1.1.1 Helicopter

1.6.1.2 OOV

COMMS

1.6.1.3 Storage

F1.2.1/2.1 F1.2.1/2.2 F1.2.1/2.3 F1.2.1/2.4 F1.2.1/2.5 F1.2.1/2.6 F1.3.1.1/2.1 F1.3.1.1/2.2 F1.3.1.1/2.3 F1.3.1.1/2.4 F1.3.1.1/2.5 F1.3.1.1/2.6 F1.4.1.1 F1.4.1.2 F1.4.1.3 F1.4.1.4 F1.4.1.5 F1.4.1.6 F1.5.1.1.1 F1.5.1.1.2 F1.5.1.1.3 F1.5.1.1.4 F1.5.1.1.5 F1.5.1.1.6 F1.5.1.1.7 F1.6.1.1 F1.6.1.2 F1.6.1.3 F1.6.1.4 F1.6.1.5 F1.6.1.2.1 F1.6.1.3.1

Operate & Control Sense Localize /

Track Communicate Onboard Processing Navigate Operate &

Control Sense Localize / Track Communicate Status /

Diagnostics Navigate Operate & Control Sense Localize /

track Communicate Navigate Onboard Processing

Operate & Control

Communicate/Relay Sense Classify Localize Attack? BDA

Data Fusion & Contact

ManagementCAUSS Display Mission

PlanningSonar

OperationsControl & Data Links

Weapons, HAZMAT,

CPG

1.6 Mission Package Support

1.6.1 MPSE/COMMS/Storage

1.3.1.1 UTAS / 1.3.1.2 MSOBS

1.5 UAV Mission Module

1.5.1 VTUAV

1.4 Mid-Frequency Monostatic Mission Module

1.2.1.1 RTA / 1.2.1.2 RTAS

1.2 Mid-Frequency Bistatic Mission module 1.3 LF Bistatic Mission Module

1.2.1 RMV(2)

1.6.1.1 MPCE

1.3.1/ 1.4.1 USV(2)

1.4.1. UDS 1.5.1.1 VTUAV Payload

2.1.1.1 Crew

F2.1.1.1.1 F2.1.1.2.1 F2.1.1.2.2 F2.1.1.2.3 F2.1.1.2.4 F2.1.1.3.1 F2.1.1.3.2 F2.1.1.4.1 F2.1.1.4.2 F2.1.1.4.3 F2.1.1.4.4 F2.1.1.4.5 F2.1.1.5.1 F2.1.1.5.2 F2.1.1.5.3 F2.1.1.5.4 F2.1.1.6.1 F2.1.1.6.2 F2.1.1.6.3 F2.1.1.6.4

Ship Operations Ship-Ship Ship-to-Shore

Ship to Off-Board

Systems

Ship to Force ASW Assets

MM Deploy Crew

Deploy/Recover MM MP Control Data

Processing Display Mission Planning Test MP Mission

PlanningEnv. Data Gathering Coordination Common

Processing Weapon DCL Counter Evade Mission recovery

2.1 Host Platform

2.1.1 (a) LCS (LM), 2.1.1 (b) LCS (NG)

2.1.1.6 Ship Defense2.1.1.3 MS Handling Systems

2.1.1.2 Communications (Various Radios & Nets)) 2.1.1.5 Command & Control2.1.1.4 Mission Package Support Equipment

3.1.1.2 Depot & OEM

F3.1.1.1.1 F3.1.1.1.2 F3.1.1.1.3 F3.1.1.2.1

Train MP personnel

Store & Maintain Equip

Transport MP

Equipment

Accept & Refurb Equip

3.1 Maintenance and Storage

3.1.1.1 MP Shore/IMA

3.1.1 MP Shore/IMA/Depot

4.1.1.1 Network

(GIG/ForceNet)

4.1.2.1 P8-A, P3-C

4.1.2.2 Force Helo's

4.1.2.3 Other ASW Assets

4.1.2.4 Theater ISR

F41.1.1.1 F4.1.1.2.1 F4.1.1.2.2 F4.1.1.3.1 F4.1.1.3.2 F4.1.1.4.1 F4.1.1.4.2 F4.1.1.4.3 F4.1.2.1.1 F4.1.2.2.1 F4.1.2.3.1 F4.1.2.4.1

Communications ASWC TASW

Common Tactical Picture

Common Operational

Picture

Area assignment

Sensor employment

Mutual Interfeerence

Cooperative ASW

Cooperative ASW

Cooperative ASW Cueing

4.1.1.4 Mission Planning

4.1 Theater Assets

4.1.1 CSG/ESG Platforms 4.1.2 Other Assets

4.1.1.3 Common Picture

4.1.1.2 ASW Command &

Control

LCS ASW SoS PilotSystem and Functions ( Matrix 1 & 2)

1. OOV/Sensors

2. Host Platform

4. Theater Assets

Page 22: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

22

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering

Capability Performance Metrics(Matrix #2)

M2.1 M2.2 M2.3 M2.4 M2.5 M3.1 M3.2 M3.3 M3.4

Deploy/Recovery Feasibility

Operating Endurance Cycle Time

Operating Range from

Ship

Technical Maturity or Risk

Communication Robustness Interoperability Flexibility &

Adaptibility Logistics & Readiness

M2 System Employment Metrics M3 SOS Metrics

M1.1.1 M1.1.2 M1.1.3 M1.1.4 M1.1.5 M1.1.6 M1.2.1 M1.2.2 M1.2.3 M1.2.4 M1.2.5 M1.2.6

Search Rate/Coverage Detect/Class Track False Contact

Rate

LCS Mission Sustainment

(days)

Area Environmental Understanding

Redetect & Class Localize Engage Kill

Asset Availability/Respo

nsiveness

Weapon Availability

M1.1 ASW Search M1.2 Kill Chain Metrics

Page 23: System of Systems Engineering Pilot Quality Function … · 2017. 5. 19. · 1 ASW SoS Systems Engineering Pilot – QFD Analysis 10thth Annual Systems Engineering Conference Session

23

ASW SoS Systems Engineering Pilot ASW SoS Systems Engineering Pilot ––QFD Analysis QFD Analysis 1010thth Annual Systems Engineering ConferenceAnnual Systems Engineering Conference

Session Session -- T&E in Systems Engineering T&E in Systems Engineering