military police host nation policing simulation: a case study into designing experiential games to...
DESCRIPTION
Case Study presentation given at LEEF 2011 by Amy Morrison, Joy Pachuki and Ron Punako for Concurrent Technologies Corporation (CTC)TRANSCRIPT
Amy MorrisonDirector, Software DevelopmentJoy PachuckiInstructional DesignerRon PunakoSoftware Engineer June 16, 2011
Military Police Host Nation Policing Simulation: A Case Study into Designing Experiential Games to Meet
Instructional Objectives
CTC Overview
• 501(c)(3) nonprofit established in 1987• Staff of 1,400+ professionals• More than 50 locations• 900,000 sq. ft., including labs & demonstration space• Top 100 Government Contractor • Quality/EH&S Management System comprised of industry-
best models: ISO 9001 (Quality) and 14001 (Environmental), AS9100 (Aerospace), and CMMI-SE/SW (Systems/Software Engineering)
• Nationally recognized security capabilities with 300,000+ sq. ft. of Top Secret/Sensitive Compartmented Information Facility Space, JWICS, SIPRNet, and NIPRNet access
• Award-winning education and training solutions team
• Human Capital Strategic Planning
• Curriculum and Content Development and Distribution
• Learning, Education and Training Assessment and Evaluation
• Learning Technologies
• Modeling, Gaming and Simulation
• Knowledge Engineering
• Collaborative Environments
• Exercise Support
Learning and Human Performance Solutions
BackgroundProgram goals
Counter Insurgency (COIN) & Stabilization, Security, Transition, and Reconstruction Operations (SSTRO)
Overall goal: Develop a training exercise that enables learners to evaluate the security posture of a host-nation police station and build rapport with the host-nation police force.
BackgroundStakeholders
• Army Research Laboratory (ARL)
• Leonard Wood Institute (LWI)
• US Army Military Police School (USAMPS)
BackgroundAudience profile
BackgroundDevelopment challenges
• Easily operable / no training time
• Train students who have finished Police Transition Team and Police Mentorship Team Training
• Continue with Virtools or move to Unity?
• Small time frame and budget
BackgroundKey development facts
• 2009-2010 prototype
• Development time 6 months
• Rebuilt Virtools REAL engine and SAT in Unity– Unity received Certificate of Networthiness from Army &
Air Force in May
• Designed and implemented scenario
• Small team
BackgroundWhat kind of team?
• Artists
• Modelers/Animators
• Information Architects
• Instructional Designers
• Integrators
• Program/Project Manager
• Software Engineers
• Sound Engineer
• Subject Matter Experts
• Video Engineer
• Voice Actors
• Writers
BackgroundSolution system
Learners experience realistic environments, characters and cultural contexts
Learners explore a virtual host nation police station
A supporting cast of characters influence the learner
Learners investigate and make decisions regarding station security while building rapport
Learners make challenging decisions
Learners progress through a scenario event sequence
Feedback and after action reviews enable reflection on performance
Learners receive just-in-time performance feedback
Learner performance is scored
Learner makes a choice Score is averaged by objective and recoded
Final score is averaged across objective scores
Objective 1: 50%Objective 2: 100%…
Final: 75%1. Choice A
2. Choice B3. Choice C
Learner makes a choice Feedback is recorded by objective.
Feedback is provided to learner
Objective 1: Good Job! …
Good Job! You chose choice A. Choice A was best because…
1. Choice A2. Choice B3. Choice C
Quantitative
Qualitative +
Systems Development Life Cycle
22
Systems Development Life CycleAnalysis
• Project Planning– Initial Client Meetings
• Instructional Intent– Assess Training Needs– Determine Training
Solution
• Client Requirements
• Technical Specifications Identified and Analyzed
EngineeringRequirements development and management
Use Case
Client Requirement Derived
Requirement
Test Case
TRACEABILITY & PROCESS VISIBILITY
“The player makes decisions through dialogue with Non-Player Characters (NPC).”
“The simulation shall enable the learner to progress through making decisions.” “The simulation shall provide the capability
to respond to character dialogue.”
“PASS: The simulation enables the learner to progress through making decisions.”
24
Systems Development Life CycleDesign
• Concept Paper Development
• Simulation Course Outline
• Screenplay Development
• Initial Product Asset Development
• Technical System Design
Systems Development Life CycleDesign Continued
EngineeringDesign
Technical SolutionArt PlanInformation Architecture
27
Systems Development Life CycleDevelopment
• Text Simulation Development
• Asset Development
• Product Development
EngineeringDevelopment
Game EngineScenario
Authoring Tool
Sound Subsystem
Animation Subsystem
Event Sequencing Subsystem
Notification Subsystem
Lipsync Subsystem
UI/Menu Subsystem
ScoringSubsystem
Character AI Subsystem
REAL
EngineeringDevelopment
Scenario Integration
with Authoring Tool
Asset Development
SoundVideo
Models & Animation
Event Sequence
Scoring
SoundVideo
Models & Animation
Event Sequence
Scoring
Scenario
30
Systems Development Life CycleImplementation
• Verification for adherence to instructional specifications
• Final product installation
• Validation testing and discrepancies resolved
• Product training conducted
• Final review and acceptance
EngineeringVerification testing
ID: TST1 Prerequisites: 1. The system must be started 2. The simulation subsystem must be
started
Actions: 1. NPC engages the learner’s character
in dialogue 2. Learner attempts to select a dialogue
response
Outcome: 1. Pass: The learner is able to select a
response to character dialogue 2. Fail: The learner is not able to select a
response to character dialogue
Trace toDerived
Requirement
“The simulation shall provide the capability to respond to character dialogue.”
32
Systems Development Life CycleEvaluation
• Evaluation tasks directly planned in support of individual efforts, if applicable, would apply to each part of the process
33
Direct outcomes from challenges
• Rebuilt REAL system and developed exercise in 6 months
• REAL enabled rapid development of the MPHNP exercise
• Employed information architecture for easily operable training
• Employed sound development processes
34
Other results
• Visual representation of structured training for rapid development
• Teams build small simulations in a few weeks
• Savings vs. traditional development
Questions and Comments
Contact Information
Amy Morrison(814) [email protected]
Joy Pachucki(814) [email protected]
Ron Punako(814) [email protected]
Conclusion and Hands-on Demo
REAL Video
(http://www.youtube.com/user/ConcurrentTechCorp#p/u/0/27QMKTeWk8c)
Putting ideas into action.SM
1-800-CTC-4392www.ctc.com