study objective

16
Innovative Technology in the Public Interest TM 1 Innovative Technology in the Public Interest TM 1 Impact of Encroachment on Military Training Quality A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges National Defense Industrial Association 30 th Environmental and Energy Symposium and Exhibition April 7, 2004

Upload: jag

Post on 15-Jan-2016

27 views

Category:

Documents


1 download

DESCRIPTION

Impact of Encroachment on Military Training Quality A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges National Defense Industrial Association 30 th Environmental and Energy Symposium and Exhibition April 7, 2004. Study Objective. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Study Objective

Innovative Technology in the Public InterestTM 11Innovative Technology in the Public InterestTM 11

Impact of Encroachment on Military Training Quality

A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges

National Defense Industrial Association 30th Environmental and Energy Symposium and Exhibition

April 7, 2004

Impact of Encroachment on Military Training Quality

A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges

National Defense Industrial Association 30th Environmental and Energy Symposium and Exhibition

April 7, 2004

Page 2: Study Objective

Innovative Technology in the Public InterestTM 22Innovative Technology in the Public InterestTM 22

Study ObjectiveStudy Objective

Create a methodology that determines the Create a methodology that determines the contribution and significance of encroachment and contribution and significance of encroachment and training workarounds to degraded mission skills.training workarounds to degraded mission skills.

Create a methodology that determines the Create a methodology that determines the contribution and significance of encroachment and contribution and significance of encroachment and training workarounds to degraded mission skills.training workarounds to degraded mission skills.

Page 3: Study Objective

Innovative Technology in the Public InterestTM 33Innovative Technology in the Public InterestTM 33

Reviewed Previous EffortsReviewed Previous Efforts

• Skills Based Training (CNA) Skills Based Training (CNA)

• Camp Pendleton (USMC and SRA)Camp Pendleton (USMC and SRA)

• SAF/IE Capacity Analysis (BAH)SAF/IE Capacity Analysis (BAH)

• ATTAC & ISR Enhancements (Army DCSOPS/G3)ATTAC & ISR Enhancements (Army DCSOPS/G3)

• Navy Range Needs Assessment -- Air to Ground Navy Range Needs Assessment -- Air to Ground Ranges (N44)Ranges (N44)

• PACFLEET Encroachment Matrix (N433)PACFLEET Encroachment Matrix (N433)

• Skills Based Training (CNA) Skills Based Training (CNA)

• Camp Pendleton (USMC and SRA)Camp Pendleton (USMC and SRA)

• SAF/IE Capacity Analysis (BAH)SAF/IE Capacity Analysis (BAH)

• ATTAC & ISR Enhancements (Army DCSOPS/G3)ATTAC & ISR Enhancements (Army DCSOPS/G3)

• Navy Range Needs Assessment -- Air to Ground Navy Range Needs Assessment -- Air to Ground Ranges (N44)Ranges (N44)

• PACFLEET Encroachment Matrix (N433)PACFLEET Encroachment Matrix (N433)

Page 4: Study Objective

Innovative Technology in the Public InterestTM 44Innovative Technology in the Public InterestTM 44

Review FindingsReview Findings

• Training Range and Facility Impact Analysis Methodologies…Training Range and Facility Impact Analysis Methodologies…- Focus on resource optimization (i.e., capacity analysis) and constraints on Focus on resource optimization (i.e., capacity analysis) and constraints on

full/effective usefull/effective use- Link Encroachment to Training Facility Mission Link Encroachment to Training Facility Mission - May not directly address effect of Encroachment on Training QualityMay not directly address effect of Encroachment on Training Quality- Encroachment Effect measured by Percentage of Land Available or Maps of Usable Encroachment Effect measured by Percentage of Land Available or Maps of Usable

Facility, etc.Facility, etc.

• Readiness Impact Analysis Methodologies …Readiness Impact Analysis Methodologies …- Tie Location to a Training Requirement (Mission Essential Task)Tie Location to a Training Requirement (Mission Essential Task)- Link Encroachment to Readiness RatingLink Encroachment to Readiness Rating- May not directly link a Readiness Rating to a Specific RangeMay not directly link a Readiness Rating to a Specific Range- May not address the May not address the significancesignificance of an encroachment factor on a Readiness Rating of an encroachment factor on a Readiness Rating

• Training Range and Facility Impact Analysis Methodologies…Training Range and Facility Impact Analysis Methodologies…- Focus on resource optimization (i.e., capacity analysis) and constraints on Focus on resource optimization (i.e., capacity analysis) and constraints on

full/effective usefull/effective use- Link Encroachment to Training Facility Mission Link Encroachment to Training Facility Mission - May not directly address effect of Encroachment on Training QualityMay not directly address effect of Encroachment on Training Quality- Encroachment Effect measured by Percentage of Land Available or Maps of Usable Encroachment Effect measured by Percentage of Land Available or Maps of Usable

Facility, etc.Facility, etc.

• Readiness Impact Analysis Methodologies …Readiness Impact Analysis Methodologies …- Tie Location to a Training Requirement (Mission Essential Task)Tie Location to a Training Requirement (Mission Essential Task)- Link Encroachment to Readiness RatingLink Encroachment to Readiness Rating- May not directly link a Readiness Rating to a Specific RangeMay not directly link a Readiness Rating to a Specific Range- May not address the May not address the significancesignificance of an encroachment factor on a Readiness Rating of an encroachment factor on a Readiness Rating

To meet our objective both methodologies needed to be harmonized and enhanced

Page 5: Study Objective

Innovative Technology in the Public InterestTM 55Innovative Technology in the Public InterestTM 55

Developed a Conceptual FrameworkDeveloped a Conceptual Framework

Range Capability

Mission Requirement

METLS

Completion Completion RatesRates

Training Training TasksTasks

Range Range CapacityCapacity

Skill Proficiency

Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Training and Results in Degraded Skill ProficiencyTraining and Results in Degraded Skill Proficiency

Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Training and Results in Degraded Skill ProficiencyTraining and Results in Degraded Skill Proficiency

Page 6: Study Objective

Innovative Technology in the Public InterestTM 66Innovative Technology in the Public InterestTM 66

Conceptual ModelConceptual Model

Range Capacity to Range Capacity to Support METLSupport METL

METL Task METL Task Completion RateCompletion Rate

Estimated Estimated Effectiveness Effectiveness

Per Training TaskPer Training Taskxx

Skill Skill Proficiency Proficiency

ScoreScore=

Impacted Training ProficiencyImpacted Training Proficiency

Page 7: Study Objective

Innovative Technology in the Public InterestTM 77Innovative Technology in the Public InterestTM 77

Concept ElementsConcept Elements

1.1. IdentifyIdentify- Specific Combat Missions Specific Combat Missions - Combat Units and their Training/OPAREAsCombat Units and their Training/OPAREAs- Unit METLsUnit METLs

2.2. Obtain DataObtain Data- Interview Units based at specific installations and OPAREAsInterview Units based at specific installations and OPAREAs- Interview OPAREA and Training Range managersInterview OPAREA and Training Range managers- Relate contribution of conditions to training and skill acquisition Relate contribution of conditions to training and skill acquisition

performanceperformance• Internal (logistics, schedules, certifications, etc.)Internal (logistics, schedules, certifications, etc.)• External (weather, deployment, encroachment, safety)External (weather, deployment, encroachment, safety)

1.1. IdentifyIdentify- Specific Combat Missions Specific Combat Missions - Combat Units and their Training/OPAREAsCombat Units and their Training/OPAREAs- Unit METLsUnit METLs

2.2. Obtain DataObtain Data- Interview Units based at specific installations and OPAREAsInterview Units based at specific installations and OPAREAs- Interview OPAREA and Training Range managersInterview OPAREA and Training Range managers- Relate contribution of conditions to training and skill acquisition Relate contribution of conditions to training and skill acquisition

performanceperformance• Internal (logistics, schedules, certifications, etc.)Internal (logistics, schedules, certifications, etc.)• External (weather, deployment, encroachment, safety)External (weather, deployment, encroachment, safety)

IdentifyIdentifyIdentifyIdentify Obtain DataObtain DataObtain DataObtain Data AnalyzeAnalyzeAnalyzeAnalyze CorrectCorrectCorrectCorrect

Page 8: Study Objective

Innovative Technology in the Public InterestTM 88Innovative Technology in the Public InterestTM 88

Concept Elements (concluded)Concept Elements (concluded)

3.3. AnalyzeAnalyze- Calculate proficiency impactsCalculate proficiency impacts- Perform comparative impact analysesPerform comparative impact analyses- Determine root causes of skill proficiency impactsDetermine root causes of skill proficiency impacts- Identify options to mitigate the impact of root causes on skill Identify options to mitigate the impact of root causes on skill

proficiencyproficiency

4.4. CorrectCorrect- Determine which root cause factors should be addressed locally, Determine which root cause factors should be addressed locally,

regionally, or nationallyregionally, or nationally- Assign responsibility for corrective actionAssign responsibility for corrective action

3.3. AnalyzeAnalyze- Calculate proficiency impactsCalculate proficiency impacts- Perform comparative impact analysesPerform comparative impact analyses- Determine root causes of skill proficiency impactsDetermine root causes of skill proficiency impacts- Identify options to mitigate the impact of root causes on skill Identify options to mitigate the impact of root causes on skill

proficiencyproficiency

4.4. CorrectCorrect- Determine which root cause factors should be addressed locally, Determine which root cause factors should be addressed locally,

regionally, or nationallyregionally, or nationally- Assign responsibility for corrective actionAssign responsibility for corrective action

IdentifyIdentifyIdentifyIdentify Obtain DataObtain DataObtain DataObtain Data AnalyzeAnalyzeAnalyzeAnalyze CorrectCorrectCorrectCorrect

Page 9: Study Objective

Innovative Technology in the Public InterestTM 99Innovative Technology in the Public InterestTM 99

Five Step Methodology for Concept ValidationFive Step Methodology for Concept Validation

2. Site Visits

Unit SurveyUnit Survey

Range SurveyRange Survey

1. Target Specific Units

Identify Characteristics of Ranges and Training Areas

Identify Characteristics of Ranges and Training Areas

Unit METLUnit METL

DatabaseDatabase

3. Data Inputs

4. Impact Analysis

Baseline Impact AnalysisBaseline Impact Analysis

Survey Report Impact Analysis

Survey Report Impact Analysis

5. Root Cause Analysis

Database Reports on Specific METL Activities

Database Reports on Specific METL Activities

Page 10: Study Objective

Innovative Technology in the Public InterestTM 1010Innovative Technology in the Public InterestTM 1010

Concept Validation Field StudyStep 1: Target Specific UnitsConcept Validation Field StudyStep 1: Target Specific Units

• Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers of the Squadron’s training rangesof the Squadron’s training ranges- Naval Auxiliary Landing Field (NALF), VANaval Auxiliary Landing Field (NALF), VA- Dare County Bombing Range, NCDare County Bombing Range, NC- TACTS ranges comprising Virginia Capes, MD, VA, NCTACTS ranges comprising Virginia Capes, MD, VA, NC- Fallon Range Training CenterFallon Range Training Center

• Four core mission skill sets analyzedFour core mission skill sets analyzed- MobilityMobility- Strike warfareStrike warfare- Anti-air warfareAnti-air warfare- Amphibious warfareAmphibious warfare

• Each mission has a defined number of tasks for trainingEach mission has a defined number of tasks for training

• Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers of the Squadron’s training rangesof the Squadron’s training ranges- Naval Auxiliary Landing Field (NALF), VANaval Auxiliary Landing Field (NALF), VA- Dare County Bombing Range, NCDare County Bombing Range, NC- TACTS ranges comprising Virginia Capes, MD, VA, NCTACTS ranges comprising Virginia Capes, MD, VA, NC- Fallon Range Training CenterFallon Range Training Center

• Four core mission skill sets analyzedFour core mission skill sets analyzed- MobilityMobility- Strike warfareStrike warfare- Anti-air warfareAnti-air warfare- Amphibious warfareAmphibious warfare

• Each mission has a defined number of tasks for trainingEach mission has a defined number of tasks for training

Page 11: Study Objective

Innovative Technology in the Public InterestTM 1111Innovative Technology in the Public InterestTM 1111

Concept Validation Field Study

Step 2: Data/Information CollectionConcept Validation Field Study

Step 2: Data/Information Collection

• SurveysSurveys- Range-specific QuestionnaireRange-specific Questionnaire

• Given to range managers, environmental staff, logistics personnel, Given to range managers, environmental staff, logistics personnel, training event plannerstraining event planners

• 27 questions focused on range characteristics, encroachment 27 questions focused on range characteristics, encroachment present, knowledge of training workaroundspresent, knowledge of training workarounds

- Unit-level QuestionnaireUnit-level Questionnaire

• Given to unit commanders and unit training officersGiven to unit commanders and unit training officers• 16 questions focused on training to task, supplemental training, and 16 questions focused on training to task, supplemental training, and

training effectivenesstraining effectiveness

• SurveysSurveys- Range-specific QuestionnaireRange-specific Questionnaire

• Given to range managers, environmental staff, logistics personnel, Given to range managers, environmental staff, logistics personnel, training event plannerstraining event planners

• 27 questions focused on range characteristics, encroachment 27 questions focused on range characteristics, encroachment present, knowledge of training workaroundspresent, knowledge of training workarounds

- Unit-level QuestionnaireUnit-level Questionnaire

• Given to unit commanders and unit training officersGiven to unit commanders and unit training officers• 16 questions focused on training to task, supplemental training, and 16 questions focused on training to task, supplemental training, and

training effectivenesstraining effectiveness

Page 12: Study Objective

Innovative Technology in the Public InterestTM 1212Innovative Technology in the Public InterestTM 1212

Concept Validation Field StudyConcept Validation Field StudyStep 3: Data InputsStep 3: Data Inputs

Interview specific to selected Mission Training Interview specific to selected Mission Training activities [COMNAVAIRFORINST 3500.1 and activities [COMNAVAIRFORINST 3500.1 and

COMNAVSURFORINST 3502.1]COMNAVSURFORINST 3502.1] Carrier (CVW) Strike Fighter Squadron (VF/VFA) (F/A-18C, F-14A) Encroachment Impact Analysis

Training to Task Question Series

Supplemental Training Question Series

Estimate of Training Effectiveness Question Series

Core Missions / Tasks COMNAVAIRFORINST 3500.1

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 Strike Fighter Squadron (VF/VFA) (F/A-18C, F-14A)

Mobility (MOB) (4) Air Navigation (MOB 201) Field Carrier Landing Practice (MOB 202)

Carrier Qualification (MOB 203) Inflight Refueling (MOB 204) MSN/Recovery Tanker (MOB 205) Strike Warfare (STW) (30) Target Acquisition (STW 201) Target Attack-Visual (STW 202) Target Attack-Sensor (STW 203) Target Attack-GPS (STW 204) Air-to-Ground Strafe (STW 205) Paraflare BMB (STW 206) SACT (STW 207) Low Altitude Tactics Training (STW 208)

Low Level (STW 209) Night Vision Device Low Level (STW 210)

LST (STW 211) Self-Escort Strike (STW 212) Coordinated/CVW/Joint Strike (STW 213)

Anti-Surface Warfare (STW 214) Close Air Support/Forward Air Controller (Airborne) (STW 215)

Combat Search and Rescue/ RESCAP/RESCORT (STW 216)

Coordinated MINEX (STW 217) Reconnaissance (STW 218) High-Speed Anti-Radiation Missile/

Example:Example: VF/VFA (F/A-18C, F14A) VF/VFA (F/A-18C, F14A)•MobilityMobility•Strike WarfareStrike Warfare•Antiair WarfareAntiair Warfare•Amphibious WarfareAmphibious Warfare•Antisurface WarfareAntisurface Warfare•Mine WarfareMine Warfare

Responses captured and entered Responses captured and entered into a database for analysisinto a database for analysis

Generic Survey with METL-specific ResponsesGeneric Survey with METL-specific Responses

Page 13: Study Objective

Innovative Technology in the Public InterestTM 1313Innovative Technology in the Public InterestTM 1313

Concept Validation Field Study Training Step 4: Impact Analysis Concept Validation Field Study Training Step 4: Impact Analysis

• An algorithm is used to calculate “scores” for baselined and survey reported METL performance data to enable variance analysis

• Similar scores for Baselined and Reported METL performance indicates training/workarounds are successful

• Dissimilar scores for baselined and reported METL performance indicates proficiency issues; requires Root Cause analysis.

• “Strike Warfare” example above illustrates which scores need root cause analysis

Training Quality Impact Analysis Tool Populated with Field Study DataTraining Quality Impact Analysis Tool Populated with Field Study Data

Mission Type for CVW Fighter

Squadron (F-14B)

Actual Range Complex

Capabilities (a)

Required Range

Capabilities (b)

Range Capability Index (a/b)

Tasks Completed (c)

Total METL Tasks (d)

Task Completion Index (c/d)

Encroachment Factors

Impacting Training (e)

Total Encroachment

Factors Present (f)

Encroachment Impact Index (e/f)

Actual Effectiveness

Score (h)

Maximum Effectiveness

Score (i)

Effectiveness Index (h/i)

Impacted Training Quality Score (z)

Mobility: Baseline 3 4 0.75 5 5 1.00 1 2 0.5 40 40 1.000 27Mobility: Survey Responses 3 4 0.75 4 5 0.80 4 7 0.6 33 40 0.825 24

Strike Warfare: Baseline 8 13 0.62 19 19 1.00 1 3 0.3 128 128 1.000 49Strike Warfare: Survey Responses 8 13 0.62 1 19 0.05 3 8 0.4 16 128 0.125 103

Amphibious Warfare: Baseline 1 1 1.00 1 1 1.00 1 3 0.3 8 8 1.000 30

Amphibious Warfare: Survey Responses 1 1 1.00 1 1 1.00 1 3 0.3 8 8 1.000 30

Page 14: Study Objective

Innovative Technology in the Public InterestTM 1414Innovative Technology in the Public InterestTM 1414

Concept Validation Field Study: Step 5: Root Cause Analysis via DatabaseConcept Validation Field Study: Step 5: Root Cause Analysis via Database

• Allowed trace-back to main root causesAllowed trace-back to main root causes- Munitions use restrictionsMunitions use restrictions- Inadequate physical conditionsInadequate physical conditions- Inadequate training facilityInadequate training facility

• Analysis revealed specific reasons for lower-than-expected Analysis revealed specific reasons for lower-than-expected training proficiency skills and task completion rates in strike training proficiency skills and task completion rates in strike warfarewarfare

- Physical ability of the range or training area to accept additional increases in user demand (capacity Physical ability of the range or training area to accept additional increases in user demand (capacity constraints)constraints)

- Training airspace corridors (private and commercial encroachment)Training airspace corridors (private and commercial encroachment)- Restrictions on munitions use due to resources need to clean or clear material from the ranges Restrictions on munitions use due to resources need to clean or clear material from the ranges

(safety concerns, fire hazards, ESA)(safety concerns, fire hazards, ESA)- Electronic equipment and general safety (logistics supply)Electronic equipment and general safety (logistics supply)- Hours of operation restrictions (community issues with noise)Hours of operation restrictions (community issues with noise)

• Allowed trace-back to main root causesAllowed trace-back to main root causes- Munitions use restrictionsMunitions use restrictions- Inadequate physical conditionsInadequate physical conditions- Inadequate training facilityInadequate training facility

• Analysis revealed specific reasons for lower-than-expected Analysis revealed specific reasons for lower-than-expected training proficiency skills and task completion rates in strike training proficiency skills and task completion rates in strike warfarewarfare

- Physical ability of the range or training area to accept additional increases in user demand (capacity Physical ability of the range or training area to accept additional increases in user demand (capacity constraints)constraints)

- Training airspace corridors (private and commercial encroachment)Training airspace corridors (private and commercial encroachment)- Restrictions on munitions use due to resources need to clean or clear material from the ranges Restrictions on munitions use due to resources need to clean or clear material from the ranges

(safety concerns, fire hazards, ESA)(safety concerns, fire hazards, ESA)- Electronic equipment and general safety (logistics supply)Electronic equipment and general safety (logistics supply)- Hours of operation restrictions (community issues with noise)Hours of operation restrictions (community issues with noise)

Page 15: Study Objective

Innovative Technology in the Public InterestTM 1515Innovative Technology in the Public InterestTM 1515

Project ConclusionsProject Conclusions

1.1. Field study validated concept and methodologyField study validated concept and methodology2.2. Identified specific impacts from encroachment vs. range capacity Identified specific impacts from encroachment vs. range capacity

constraintsconstraints3.3. Method able to identify root causes of degraded trainingMethod able to identify root causes of degraded training4.4. Effort builds on capacity analysis models of encroachment: Effort builds on capacity analysis models of encroachment:

- Uses existing data from range inventoryUses existing data from range inventory- Uses official Service METLs or training instructions to baseline proficiency Uses official Service METLs or training instructions to baseline proficiency

requirements against actual training resultsrequirements against actual training results- Integrates mission training impacts (delayed, modified, relocated, cancelled) with Integrates mission training impacts (delayed, modified, relocated, cancelled) with

encroachment pressures encroachment pressures

5.5. Identifies encroachment impact on specific training activities to help Identifies encroachment impact on specific training activities to help mitigation actions and investment decisionsmitigation actions and investment decisions

1.1. Field study validated concept and methodologyField study validated concept and methodology2.2. Identified specific impacts from encroachment vs. range capacity Identified specific impacts from encroachment vs. range capacity

constraintsconstraints3.3. Method able to identify root causes of degraded trainingMethod able to identify root causes of degraded training4.4. Effort builds on capacity analysis models of encroachment: Effort builds on capacity analysis models of encroachment:

- Uses existing data from range inventoryUses existing data from range inventory- Uses official Service METLs or training instructions to baseline proficiency Uses official Service METLs or training instructions to baseline proficiency

requirements against actual training resultsrequirements against actual training results- Integrates mission training impacts (delayed, modified, relocated, cancelled) with Integrates mission training impacts (delayed, modified, relocated, cancelled) with

encroachment pressures encroachment pressures

5.5. Identifies encroachment impact on specific training activities to help Identifies encroachment impact on specific training activities to help mitigation actions and investment decisionsmitigation actions and investment decisions

Page 16: Study Objective

Innovative Technology in the Public InterestTM 1616Innovative Technology in the Public InterestTM 1616

For Copies of the Full Report:For Copies of the Full Report:

[email protected]@mitretek.org

• 703-610-1540703-610-1540

[email protected]@mitretek.org

• 703-610-1540703-610-1540