1

1

UNITED STATES ARMY EVALUATION CENTER

Chris WilcoxUS Army Evaluation Center

410-306-0475

chris.wilcox1@us.army.mil

Mission-Based T&EPrimer v1.3, 2 Sep 08

2

Primer Purpose

• To introduce MBT&E definitions, framework and process.

• To generate discussions.

• To solicit feedback on MBT&E methodology.

• Caveat: Information presented in this brief is not meant to prescribe how MBT&E must be implemented. MBT&E is an ongoing methodology development effort. Readers are encouraged to ask questions, suggest ideas, and improve the process.

3

MBT&E Introduction

Mission-Based Test and Evaluation is a methodology that focuses T&E on the operational capabilities provided to the warfighter. It provides a

framework and procedure to:

– link operational capabilities to the attributes of the materiel system-of-systems;

– develop evaluation measures that assess operational capabilities and system attributes;

– and link the evaluation measures to all available data sources.

4

4

MBT&E Framework(1 of 2)

7

Set of Tasks Desired Result+

Mission Analysis• Higher Commander’s Intent• Restated Mission• Task to Subordinates

MBT&E Framework – v2

Desired MissionTask Results

Desired SoSTask Results

System Performance•Functions (shall do)• “shall be’s”

Desired SystemPerformance Results

Commander’s Taskto Subordinates

Mission Analysis• Higher Commander’s Intent• Restated Mission• Task to Subordinates

Systems Engineering• Functional Baseline• Allocated Baseline• Product Baseline

Operations (Mission Tasks)• UJTLs• Service TLs• Implied Tasks

System-of-Systems Tasks• Service TLs• Implied Tasks• Collective/Individual Tasks

Process/Products

Enables

Enables

Enables

Capability =

Mission Task Capability

SoS Task Capability

System Performance

Commander’s Taskto Subordinates

System Attributes

Transition to Allocating Mission Means

Transition to Allocating SoS Means

Transition to Allocating Materiel Means

DesiredEnd State

High LevelTasks/Results(Levels 1& 2)

Tasks/ResultsSpecific to System(Level 3)System Functions(Level 4)

5

5

MBT&E Framework(2 of 2)

6

MBT&E Framework – v2

Desired MissionTask Results

Desired SoSTask Results

System Performance•Functions (shall do)• “shall be’s”

Desired SystemPerformance Results

Mission Task Capability Measure

SoS TaskCapabilityMeasure

SystemPerformance

Measure

Evaluated by

Operations (Mission Tasks)• UJTLs• Service TLs• Implied Tasks

System-of-Systems Tasks• Service TLs• Implied Tasks• Collective/Individual Tasks

Enables

Enables

Enables

Set of Tasks Desired ResultCapability = +

Mission Task Capability

SoS Task Capability

System Performance Capability

DesiredEnd State

Tested by

Contractor Test

DevelopmentalTest

OperationalTest

M&S

DemonstratedCertifications

6

•Steps divided into 5 major purpose areas.

REPORT THERESULTS

UNDERSTAND THEMISSION

MBT&E Procedure Overview

UNDERSTAND THESYSTEM

DESIGN THE TESTAND EVALUATION

DETERMINE THERESULTS

• 1 Pre-step to understand the program context.

• 4 steps to understand the military missions, operations, tasks, capabilities and operational context.

• 2 steps to understand the components and attributes of the materiel system-of-systems.

• 1 additional step to develop the mission to system linkages.

• 7 steps to design the T&E given the mission and system understanding.

• 3 steps to generate, collect, analyze, and evaluate the data.

• 1 step to format and report the results.

7

Purpose: Collect available information to gain understanding of: initiating capability gap, mission context, system-of-systems design and required attributes, etc.

Key Activities: Search for and archive all information on…

• capability gap analysis and mission context,• Capabilities Based Analysis (functional area, need and solution analyses),

Analysis of Alternatives, Defense Planning Scenarios, System Threat Analysis Report, etc.

• materiel solution requirements,• DoD Architecture Framework Products, Requirements Documents, etc.

• materiel system design.• Critical Technologies, Work Breakdown Structure, Performance

Specifications, etc.

Key Output:– Mission Context Library– Capability Requirement Library– System Description Library.

Collect Information (Step 1)

8

Understand the Mission

Steps required to understand the mission context, tasks, and capabilities.

– 4 Major Steps• Identify Mission Context (step 2)

– Operations and threat, terrain and weather conditions.

• Identify Mission Tasks (step 3)• Identify Supporting Tasks (step 4)• Identify and Assign Task Capabilities (step 5)

9

Purpose: Define the overall mission context that the proposed materiel solution is to support.

Requirements: “The process shall…”• describe the system-of-system (SoS) construct to include materiel

systems not under evaluation but required to provide warfighter capability to support the operations and capabilities.

• describe the operational conditions (operational variables) that a unit, system or individual is expected to operate under and may effect achievement of the capability. The conditions will be defined as expected at the time of fielding.

• describe the high-level mission tasks (down to the SoS task-level) and their required results (standards) where applicable.

• describe the organizational and support unit/system construct.

• align with the products of capabilities based analysis and DoD Architecture Framework products.

Understand the MissionDefine the Mission Context (Step 2) (1 of 2)

10

Understand the MissionDefine the Mission Context (Step 2) (2 of 2)

Key Activities:• Determine Operations, Missions and Tasks

– Develop a description and relationships of high-level operations/mission/tasks (Levels 1 and 2 of the framework).

– Determine operations/mission/task required end states / results.– Determine Joint, interagency, multinational, network and SoS construct.– Determine organizational and support unit construct.

• Determine Operational Conditions– Determine the essential elements of mission, enemy, terrain and weather,

troops and support available, time available, and civil considerations.

Anticipated Products:– Operations to Missions Chart– Mission Summary Worksheets

11

Purpose: Identify the required mission tasks assigned at the SoS-level and link these tasks to applicable authoritative source.

Requirements: “The process shall…”• describe the SoS mission tasks supporting the evaluation of

effectiveness. The SoS mission tasks will form the “backbone” of the T&E strategy to allow comparison between current and new capabilities.

• focus documentation of the SoS mission tasks on the “final increment” in order to evaluate each increment’s contribution to the overall required capability and to support achievement of needed capabilities with each increment.

• document the SoS mission tasks in a temporal format.

• SoS mission tasks will be linked to authoritative sources where possible and the standards and conditions from the authoritative sources will be documented.

Understand the MissionIdentify the Mission Tasks (Step 3) (1 of

2)

12

Understand the MissionIdentify the Mission Tasks (Step 3) (2 of

2)

Key Activities:• Conduct Mission Analysis

– Develop SoS mission threads and alternate mission threads where applicable.

• Link to Authoritative Sources– Develop linkages between the tasks identified in step

(3.1) and the appropriate authoritative sources.

Anticipated Products:– List of SoS mission tasks in temporal format.– Associated Authoritative tasks.– Library of Mission Threads.

13

Purpose: Identify the required supporting tasks that enable the execution of the SoS mission tasks.

Requirement: “The process shall…”• determine the conditional mission tasks supporting the

evaluation of survivability. (Conditional tasks are performed during a normal mission but are only required due to some influencing condition. Examples: avoid threat missile, extinguish engine fire, reset network node, etc.).

• determine the enabling tasks supporting the evaluation of suitability. (Mission enabling tasks are conducted in order to enable the SoS mission tasks to be performed. Examples: train, deploy, maintain, MANPRINT, etc.).

Understand the MissionIdentify Supporting Tasks (Step 4) (1 of 2)

14

Understand the MissionIdentify Supporting Tasks (Step 4) (2 of 2)

Key Activities:• Determine Conditional Tasks

– Conditional tasks are performed during a normal mission but are only required due to some influencing condition.

– Examples: avoid threat missile, extinguish engine fire, reset network node, etc.

• Determine Enabling Tasks– Enabling tasks are conducted in order to enable the SoS mission

tasks (tasks developed in step 3) to be performed.– Examples: train, deploy, maintain, etc.

Anticipated Products:– Conditional task threads.– Enabling task threads.

15

Purpose: Identify and associate the capabilities required to execute the SoS, conditional and enabling tasks.

Requirements: “The process shall…”• determine the required capabilities in terms of the ways, means,

required result of that task, and the applicable standards.

• support documenting the required capabilities alone to support rapid acquisition initiatives.

• review and allocate capability requirements from applicable requirements documents to the tasks.

• identify tasks without previously identified capability requirements to the T&E IPT.

Understand the MissionIdentify Capabilities (Step 5) (1 of 2)

16

Understand the MissionIdentify Capabilities (Step 5) (2 of 2)

Key Activities:• Identify Required Capabilities

– Identify the capabilities required to support each task with a reference to applicable requirements sources.

• Associate Tasks with Capabilities– Link the capabilities determined above with the tasks

determined in steps (3) and (4)

Anticipated Products:– Task-to-Capabilities Description Worksheets.– Library of Capabilities.

17

Understand the System

Steps required to understand the components and attributes of the materiel system.

– 2 Major Steps• Determine SoS Components (step 6)• Identify and Assign Component Attributes (step 7)

18

Purpose: Identify the physical components of the materiel system that will provide attributes to support the mission tasks.

Requirements: “The process shall…”• determine the components of the materiel system end items that will

be required to support the applicable tasks and capabilities.

• determine the training and support systems required to support the materiel system.

• align identified components with the products developed by Systems Engineering and DoDAF, (e.g., work breakdown structures, system views, etc.).

• identify technology risk areas to allow development of mitigation strategies for the materiel system prior to the system design and development.

Understand the SystemDetermine SoS Components (Step 6)

(1 of 2)

19

Understand the SystemDetermine SoS Components (Step 6)

(2 of 2)

Key Activities:• Develop a materiel system description - starting at the

SoS level and decompose the major end items into components.• Components at the lowest level should be able to be

linked to identifiable system attributes.• Develop human-system interface description. • Develop detailed system fault trees for use in M&S

applications.• Identify technology and program risk areas for pre-MS B

systems.

Anticipated Products:– System Component Chart

20

Understand the SystemDevelop System Attributes (Step 7)

(1 of 2)

Purpose: Identify the materiel system attributes and associate them with the system components.

Requirement: “The process shall…”

• determine the attributes of the system components that will be required to support the capabilities.

• review and allocate system attribute standards from applicable requirements sources, to include system performance specifications.

• align identified attributes with the products developed by Systems Engineering.

21

Understand the SystemDevelop System Attributes (Step 7)

(2 of 2)

Key Activities:• Identify Attributes Required

– Identify the materiel system’s attributes required to support the applicable tasks and capabilities - with a reference to applicable requirements sources.

• Associate Components with Attributes– Link the attributes determined above with the system

components developed in step (6).

Anticipated Products:– Component-to-Attribute Description Worksheets.

22

Understand Mission and System

One step required to tie the understanding of the mission with the understanding of the system.

– Associate Capabilities with Component Attributes (step 8)

23

Purpose: Develop the relationships between capabilities identified in step (5) and the materiel system component attributes identified in step (7).

Requirement: “The process shall…”• establish the linkages between the required

capabilities and the required system component attributes.

• determine enabling attributes supporting the evaluation of suitability.

Mission and SystemAssociate Capabilities with Attributes (Step

8) (1 of 2)

24

Mission and SystemAssociate Capabilities with Attributes

(Step 8) (2 of 2)

Key Activities:• Link the system attributes to the capabilities.

• Determine how the system components support the capabilities.• Determine redundant component support functionality.

• Determine Enabling Attributes• Enabling attributes of the system are not specifically tied to a particular

task – they address all tasks. Examples: reliability, maintainability, etc.

• Develop degraded capability states to support M&S applications.

Anticipated Products:– Task Description Worksheet with supporting system attributes.

25

25

Design the T&E

Steps required to design the test and evaluation program given the mission(s) and materiel system.

– 7 Major Steps• Develop Unconstrained Operational Conditions (step 9)• Develop Evaluation Strategy (step 10)• Develop Evaluation Measures (step 11)• Assign Measures to Data Sources (step 12)• Develop Constrained Operational Conditions (step 13)• Develop Data Source Requirements (step 14)• Develop T&E Databases (step 15)

S13

26

Design the T&EUnconstrained Operational Conditions (Step

9) (1 of 2)

Purpose: Develop the unconstrained operational conditions that should be addressed through the T&E.

Requirement: “The process shall…”• determine the operational conditions applicable to each

mission task capability and the applicable system component attributes supporting the capability.

• develop unconstrained use case scenarios.

27

Design the T&EUnconstrained Operational Conditions (Step

9) (2 of 2)

Key Activities:• Determine the operational conditions that T&E

needs to address given:• the capability required and• the system attribute.

Anticipated Products:– Task Description Worksheets with operational

factors and conditions. – Enabling Attribute Worksheets with operational

factors and conditions.

28

Purpose: Develop a summary description of the evaluation to support an early strategy review.

Requirement: “The process shall…”• develop an early-on evaluation strategy (early

with continuous updates) that will show the linkages between the mission tasks, capabilities, system components, and component attributes.

Design the T&EDevelop the Evaluation Strategy (Step

10) (1 of 2)

29

Design the T&EDevelop the Evaluation Strategy (Step

10) (2 of 2)

Key Activities:• Develop the early strategy review brief from the

mission, task, and system worksheets developed in steps (2) through (9).

Anticipated Products:– Mission Summary.– Task Summary Chart.– System Summary Chart– Lens Chart

30

Purpose: Develop the evaluation measures.

Requirement: “The process shall…”• develop evaluation measures (mission task capability measure)

used to assess achievement of assess high-level mission required results.

• develop evaluation measures (SOS task capability measure) used to assess achievement of SoS task capabilities.

• develop evaluation measures (system performance measure) used to assess achievement of materiel system attribute performance requirements – includes both SoS and component levels.

• develop data analysis procedures for each measure.

Design the T&EDevelop Evaluation Measures (Step

11) (1 of 2)

31

Design the T&EDevelop Evaluation Measures (Step

11) (2 of 2)Key Activities:• Develop evaluation measures summaries for:

• task capabilities identified in the task description worksheets.• system attributes identified in the task description worksheets.• Net-Enabled Battle Command Issues.• Human-System Interface Issues.

• Summarize linkages from evaluation measures to system components/attributes to tasks/capabilities.

• Link measures to COIs and Criteria.

Anticipated Products:– Task description and enabling attribute worksheets with evaluation

measures.– Detailed evaluation measure design.– Task/System/Evaluation Summary Chart.

32

Purpose: Identify the sources of data to support the analysis of the evaluation measures.

Requirements: “The process shall…”• develop linkages between the evaluation measures and

the source of data supporting the measure. All sources, (contractor data, DT, OT, M&S), will be considered.

• assess the T&E program risks of successful execution and validation of system performance requirements.

Design the T&EAssign Measures to Data Sources

(Step 12) (1 of 2)

33

Design the T&EAssign Measures to Data Sources

(Step 12) (2 of 2)Key Activities:• Assign one or more data sources to each evaluation

measure.• Review data source matrix to determine:

• T&E execution risk by assessing critical data sources;• Developmental risk by assessing when critical

technologies are demonstrated; and• Determine appropriate use of M&S.• Determine appropriate use of virtual and constructive

methods/tools.

• Anticipated Products:– Time-phased evaluation to data source matrix.

34

Purpose: Develop the constrained operational conditions by looking at the factors that can be addressed by the identified data sources.

Requirements: “The process shall…”• identify the operational conditions that are addressed by the

evaluation given all the available data sources.

• identify the T&E limitations in terms of the limitation, impact of the limitation, and any applied mitigation procedures.

• determine use of M&S (virtual and constructive) to address T&E limitations to include: supplementing live test data, addressing operational conditions not testable, etc.

• develop constrained use case scenarios.

Design the T&EConstrained Operational Conditions (Step

13) (1 of 2)

35

Design the T&EConstrained Operational Conditions (Step

13) (2 of 2)Key Activities:• Determine the operational conditions that can be

addressed by the identified data sources.• These are the constrained operational conditions.• This also determines the operational conditions

applicable to all data sources, to include, contractor and developmental tests.

• Determine the T&E limitations by comparing the constrained vs. unconstrained operational conditions.

• Prepare the Concept In-Process Review Brief.

Anticipated Products:– Task Description Worksheets with T&E limitations. – Enabling Attribute Worksheet with T&E limitations.

36

Purpose: Develop data elements required to support the analysis of the evaluation measures from each linked data source.

Requirement: “The process shall…”• identify data elements required by each data source.

• identify the sample size and appropriate run conditions required from each data source.

• develop a test cases to identify the live, virtual and constructive test requirements needed to support the evaluation measures.

• support the development/review of detailed test plans, to include contractor test, DT and OT.

Design the T&EDevelop Data Source Requirements (Step

14) (1 of 2)

37

Design the T&EDevelop Data Source Requirements (Step

14) (2 of 2)

Key Activities:• Develop detailed measure design.

• Determine data elements required from the data source.

• Determine the operational conditions required for each run, sortie or sample.

Anticipated Products:– Measure template or measure worksheet. – Measure worksheet with design of experiment

information.

38

Design the T&EDevelop T&E Databases (Step 15)

(1 of 2)Purpose: Develop database architecture to enable efficient formatting and

analysis of delivered data.

Requirement: “The process shall…”• develop evaluation data model and databases down to the data

element level.

• support the development of the pattern-of-analysis and data collection plan.– Help identify data collection issues and gaps.

• support the development of test databases linking the data elements to the evaluation databases.

39

Design the T&EDevelop T&E Databases (Step 15)

(2 of 2)

Key Activities:• Develop an evaluation data model from the task

description, enabling attribute, measure description worksheets.• The evaluation data model is a representation of the information

and data assets required to evaluate the system expressed in terms of entities and relationships between entities.

• Provide evaluation data model results to the tester.• The evaluation data model will ensure properly documented data

for communication between the evaluator and the tester.

Anticipated Products:– Evaluation data model list of entities and their relationships.– List of primary and derived data elements for each measure.– List of scoring criteria, factors, conditions and controls for each

measure.

40

Determine the Results

Steps required to generate, collect, analyze and evaluate data from the data sources.

– 3 Major Steps• Conduct Tests and Gather Data (step 16)• Perform Data Analysis (step 17)• Generate Evaluation Results (step 18)

41

Determine the ResultsConduct Test and Gather Data (Step

16) (1 of 2)

Purpose: Execute the planned data source activities and collect the required data for analysis.

Requirement: “The process shall…”• status the collection, authentication, delivery and adequacy of

data delivered by the data sources.

• assess the impact of program status on the T&E effort (schedule changes, system configuration changes, etc.)

42

Key Activities:• Execute test, run M&S, record data.

• Review data for integrity and authentication.

• Adjust T&E program based on impacts of changes in schedule and system design.

Key Information Output:• T&E program status.

Determine the ResultsConduct Test and Gather Data

(Step 16) (2 of 2)

43

Purpose: Perform the data analysis procedures necessary to generate evaluation results.

Requirements: “The process shall…”• analyze demonstrated system attribute performance

(system measures),

• analyze demonstrated task capability performance (mission and task measures),

• analyze network-enabled battle command performance,

• status the progress of analysis up to impact on the successful completion of the evaluation of capabilities.

Determine the ResultsPerform Data Analysis (Step 17)

(1 of 2)

44

Key Activities:• Data is analyzed according to the procedures identified in

step 11.

• Performance results are compared to standards identified in steps 5 (capabilities) and 7 (system attributes).

Key Information Output:• Mission capability measure results compared to standard.• Task capability measure results compared to standard.• System attribute measure results compared to standard.

Determine the ResultsPerform Data Analysis (Step 17)

(2 of 2)

45

Purpose: To generate evaluation conclusions based on the analysis of operational capability and system attribute performance.

Requirements: “The process shall…”• evaluate system performance.

• evaluate impact of system performance on SoS task capabilities identified in step 5.

• evaluate SoS task capabilities.

• evaluate the impact of SoS task capabilities on mission task capabilities identified in step 2.

• evaluate the mission task capabilities.

Determine the ResultsGenerate Evaluation Results (Step 18)

(1 of 2)

46

Key Activities:• Determine SoS and component attribute performance.

• Task Capabilities and Limitations. – Determine SoS task capability C&L directly from task measure results.– Determine SoS task capability C&L based on system attribute measures.

• Task C&L impact to desired mission results.– Determine ability to achieve desired end state directly from mission task

capability measure results.– Determine ability to achieve desired end state from SoS task capability

C&Ls.

Key Information Output:• System attribute performance.• Task capabilities and limitations.

Determine the ResultsGenerate Evaluation Results (Step 18)

(2 of 2)

47

Report the Results

Steps required to format and report the evaluation results.

– One Major Step• Generate Evaluation Report (step 19)

48

Purpose: To generate the evaluation report which will document the evaluation conclusions.

Requirements: “The process shall…”

• report materiel system performance and its impact on the capabilities and limitations of achieving the required capability.

• report task capabilities and limitations.

• report overall effectiveness, suitability and survivability.

Report the ResultsGenerate Evaluation Report (Step 19)

(1 of 2)

49

Report the ResultsGenerate Evaluation Report (Step 19)

(2 of 2)

Key Activities:• Generate SoS and component attribute performance.

• Generate system performance to the task C&L conclusions.

• Generate summary of key C&Ls.

• Generate system effectiveness, suitability and survivability conclusions.

Key Information Output:• System and SoS performance, strengths and weaknesses and the

impact they had on the operational capabilities.• Task C&Ls and summarized mission task C&Ls.• Overall summary of effectiveness, suitability and survivability.

50

Detail Framework/Process Slides

51

KEY

Commander’s Task to Subbordinate

Mission Analysis / Planning

System Requirements

Systems Engineering

SoS Task Capability

Standards

Desired Mission Task Results

Conditions

Mission Tasks

Desired End State

Commander’s Task to Subbordinate

Mission Analysis / Planning

Mission Task Capability

Standards

Desired Mission Task Results

Conditions

Mission Tasks

Mission Task Capability Measure

SoS Task Capability Measure

System Performance

Measure

Data Sources

Contractor Test

Developmental Test

Operational Test

M&S

Certifications

Inspections/ Demonstrations

Allocation of Mission Means

Allocation of SoS Task

Means

Allocation of Materiel Means

MISSION MATERIEL EVALUATION TEST

System Performance

Specifications

Desired System Performance

Conditions

Functions/Shall Be’s

PROCESS MEASURE DATA SOURCE

CAPABILITY

TASKDESIRED RESULT

SYSTEM PERFORMANCE

ATTRIBUTEDESIRED

PERFORMANCE

52

(7) Develop System Attributes

CAPABILITIES-BASED TEST AND EVALUATION PROCESS, v3.0

Discovery Phase Planning Phase Data Gathering Phase Data Analysis and Evaluation Phase Reporting Phase

Ove

ra

ll p

ro

ce

ss e

xte

nd

ed

to

C

ap

ab

ilitie

s B

ase

d T

&E

(10) Develop Evaluation Strategy

Develop Evaluation

Strategy (10b)

Develop MANPRINT/HIS

Analytical/Experimental

Question (10a)

(5) Identify Task Capabilities

T&

E P

ro

du

cts

(19) Generate Evaluation Report(16) Conduct Test and Gather Data(1) Collect Information

Collect information on Capability Gap

Analysis and Mission Context

(1a)

Authoritative Task Lists

WBS, Performance Specification

ORD, CDD or CPD

(6) Determine System of System

Components (Physical

Architecture)

(8) Associate Task Capabilities with

Component Attributes

Collect Information on Materiel

Solution Requirements (1b)

Collect Information on Materiel

Solution Design (1c)

(12) Assign Measures to Data

Sources

Possible Data Sources

Review Data for Integrity and

Authentication (16.3a)

Observe/Record Component/Force

State Changes (16.2c)

Assess Residual Capability (16.3c)

(17) Perform Data Analysis

Analyze System Attribute Measures

(17.1b)

Compare Analysis Results to Attribute Standards (17.2b)

Compare Residual Capability to

Required Capability (17.2d)

(18) Generate Evaluation Results

Execute Test (16.1a)

Collect Data (16.2a)

Review Data for Integrity and

Authentication (16.3b)

Collect Data (16.2b)

Run M&S (16.1b)Determine System

Performance Impact on Task

Capability (18.2b)

Evaluate Task Capability (18.3)

Analyze Task Capability

Measures (17.1c)

Compare Analysis Results to Capability

Standards (17.2c)

Analyze NEBC Issue Measures

(17.1a)

Compare Analysis Results NEBC

Standards (17.2a)

Report NEBC Impact to

Operational Tasks (20.1a)

Report Task and Mission C&Ls

(20.1c)

Report System Progress and Ability to Meet Criteria (20.1b)

No

YesMission Summary

Worksheet

Task/System Matrix

ESR Brief

Lens ChartTask Chart System Chart

CIPR Brief

Task Information Worksheet

Measure Information Sheet

System Evaluation

Plan

Evaluation/Test Matrix

Task Results Sheet

Mission Summary Chart

Evaluation Strategy Summary

Initial MANPRINT/HIS Analysis

Approach Brief

B

Attribute Worksheet

NEBC Capabilities Worksheet

C

D

Attribute Results Sheet

NEBC Capabilities Results Sheet

Evaluate System Performance

(18.1b)

System Evaluation Report

Report DOTMLPF Implications (20.2)

(9) Develop Unconstrained

Operational Conditions

System Description DL

Capability Requirements DL

Mission Context Document Library

Task Description Worksheets

System Description Worksheet T&E Limitations Analysis Plan

IT

ER

AT

E

System Analysis Report

Report Effectiveness, Suitability and

Survivability (20.3)

DOTLMPF Conclusions

Effectiveness, Suitability and Survivability Conclusions

Determine NEBC Impact on Task

Capability (18.2a)

Determine Mission Capability (18.4)

Evaluate NEBC Issues (18.1a)

Evaluate Task Performance

(18.1c)

OMS/MP

DoDAF Products

STAR

ICD

FAA, FNA, FSA (2) Define Mission Context

Determine Operations/

Missions (2a)

Determine Operational Factors and

Conditions (2b)

(3) Develop Mission Tasks

Conduct Mission Analysis (3.1)

Link to Authoritative Tasks (3.2)

(4) Develop Supporting Tasks

Determine Conditional Tasks

(5a)

Determine Enabling Tasks

(5b) (13) Develop Constrained Operational Cond.

Develop Constrained Operational

Conditions (13.1)

Identify T&E Limitations (13.2)

(14) Develop Data Source Requirements

Develop Experimental Design (14.2)

Identify Measure Data Element Requirements

(14.1)

(15) Develop T&E Database

Develop Evaluation Data

Model (15.1)

Develop Test Database(s) (15.2)

(11) Develop Evaluation Measures

A

Identify Capability Requirements

(6.1b)

Associate Tasks with Required

Capabilities (6.2)

Identify Attribute Requirements

(7.1a)

Associate Components with

Attributes (Functional

Architecture) (7.2)

UNDERSTAND THE MISSION

UNDERSTAND THE SYSTEM DESIGN THE TEST AND EVALUATION DETERMINE THE RESULTSREPORT THE RESULTS