cervus defence and security - t r a i n i n g d a t a e …...© cervus defence and security ltd...

T r a i n i n g D a t a E x p l o i t a t i o n ( T D x )

Chris Rolfs, Chief Technology Officer, Cervus Defence and Security Ltd.

14th September 2017

© Cervus Defence and Security Ltd 2017

Defini t ions• Operational Analysis (OA) Experimentation is the process of testing the validity of a hypothesis by either a

controlled process of interaction or observation, in order to acquire new knowledge about specific factors relevant to

some particular decision.

• Force Development (FD) is the process by which policy and requirement is translated into capability, and the means

by which Defence determines how and with what a military force should operate.

• Warfighting Experimentation (WFE) is a subset of OA Experimentation that involves the participation of suitably

experienced military personnel, in an appropriate operational role and in a representative environment. These will

typically happen using Live/Virtual/Constructive simulation with the intention to produce insights and evidence to

inform decision making.

• A Collective Training (CT) Event is when one or more sub-units are exercised to achieve an agreed level of

competence

• CT 1 / 2 (Platoon/Troop to Company/Squadron) – Build robust drills and common understanding

• CT 3 / 4 (Company/Squadron + Attachments to Battle Group) – Cement drills and convert to agility and momentum

• CT 5 / 6 (Brigade to Division) – Achieve integrated action outcomes

• Evidence Based Decision Making is using a scientific approach to investigate all available evidence that can lead to

policy decisions that are more effective in achieving desired outcomes as decisions are based on accurate and

meaningful information.


Goals

1. Suggest methods where Force Development (FD) can improve upon the

current efforts to leverage Collective Training (CT) Events to provide robust

evidence for business cases supporting capability development.

2. Provide those that support and deliver training a view of how they can play a

critical role in supporting wider military experimentation.

3. Provide those that are responsible for developing military capability the

understanding for what exploitation opportunities could be being enhanced

to support their work.

4. Highlight technology advances that enable Training Data Exploitation (TDx)

to be realised.


Where we are coming from

Collective Training

ExperimentationUser Trials


TDx Drivers

TDx Drivers

TechnologyResources

TrainingExternalPeer

threats

Complex Equipment

Scrutiny Wearables

Reduced Mass

AI / Data Analytics

ObjectiveRealistic

Innovation

Complex warfare

Constant competition

Fidelity


TDx Drivers- Resources

TDx Drivers

TechnologyResources


threats

Complex Equipment

Scrutiny Wearables

Reduced Mass

AI / Data Analytics

ObjectiveRealistic

Innovation

Complex warfare


Fidelity


System Engineering and Veri f icat ion

User RequirementsAcceptance Testing

System Requirements

System Design

Engineering Design

Construction

Component Testing

Integration Testing

System Testing


“Wonky W” - Real i ty

Capability Achieved

Requirements &

Design

Construction

Difference

achieved through

Experimentation

Trials defined

and

scheduledChanges

- Budgets

- Capability

- Aspirations

Aspects

changed /

scaled down

New testing and

acceptance plan


TDx Drivers- Training

TDx Drivers

TechnologyResources


threats

Complex Equipment

Scrutiny Wearables

Reduced Mass

AI / Data Analytics

ObjectiveRealistic

Innovation

Complex warfare


Fidelity


Collect ive Training Services

• Environment System – what is

required to create the appropriate

Environment

• Scenario System – what is required

to wrap around the environment with

a logical and consistent scenario

• Capture System – what is required

to capture appropriate contextual

data and performance data on the

training subjects

• Analysis System – that which is

required to collate, analyse and

manage data

• Exploitation System – what is

required to exploit the data for AAR

and as long term actionable insights

MANAGEMENT RULES

SCENARIO

ENVIRONMENT

CAPTURE SYSTEM

ANALYSIS SYSTEM

EXPLOITATION SYSTEM


Balancing Act

Training Experimentation

Focussed on the

achievement of

Collective Training

Objectives (CTOs)

Data capture

typically to

support an after action review

Known costs and budgeted

Limited opportunity

for repeatability

Focussed on the

experimentation

objectives and evidence

Data capture to

inform measures

of performance / effectiveness

Requiring

repeatabilityUnknown costs and

limited budget


TDx Drivers- Technology

TDx Drivers

TechnologyResources


threats

Complex Equipment

Scrutiny Wearables

Reduced Mass

AI / Data Analytics

ObjectiveRealistic

Innovation

Complex warfare


Fidelity


Captur ing at the lowest level

Training Subject

Detailed Analysis

Physiological Measures

Psychological Measures

Observations &

Questionnaires

Combat Performance Measures

Soldier Manpack System

Heart rate monitor

Positional

Information

© Cervus Defence and Security Ltd

POV – Situational Awareness


Training Data Exploi tat ion

CT1 CT2 CT3 CT4 CT5 CT6 Other

MANAGEMENT RULES

SCENARIO

ENVIRONMENT

CAPTURE SYSTEM

ANALYSIS SYSTEM

EXPLOITATION SYSTEM

Measures of

Performance

Data Storage

and Analytics

Long Term Training Trends and

Experimentation Reference Database


Example – CT 5 EventExample of the type of analysis that can bedone on perceived position when comparedwith the actual position of own troops.

Analysis

1. Latency in reporting position

2. Interoperability between differentsystems reducing positioninginformation.

Outcomes:

1. Support requirement development

2. Evidence for doctrine change

3. Identify need for technology change


Example – CT 2 / 3 EventExample on information flows between unitsduring different phases of during an exercise.

Analysis

1. Advancements in technology allowed for therapid capture and accurate analysis of thetype of voice message sent.

2. Comparison between voice and datacommunications

Outcomes

1. Large percentage of messages reportingtheir own position – training issue for use ofdata system / Blue force tracker.

2. Identified where passing information viadata systems allowed for more efficient useof voice communications improvingsituational awareness.

3. Demonstrated how adding instrumentationto a training event could provide evidencesupporting a change.

Enemy Forces. This message relates to enemy (OPFOR) activity or location. Mission Command. This message relates to information relating around orders, command or coordination. Non-Combat Forces. This message relates to civil population activity or location. Own Forces. This message relates to own or friendly forces activity or location.


TDx Drivers - Benefi ts

TDx Drivers

TechnologyResources


threats

Complex Equipment

Scrutiny Wearables

Reduced Mass

AI / Data Analytics

ObjectiveRealistic

Innovation

Complex warfare


Fidelity


Benefi ts

Resources• Integrated CT and FD reduces the costs of warfighting

experimentation, through efficient use of resources and time (including facilities).

• Provide evidence to support current and future acquisition, including agile development throughout the life of programmes.

• Collect once, use many – OA models / training systems / education material.

Technology• Able to capture of detailed performance information –

providing the level of fidelity required for both objective training and evidence based decision making.

• Analytics, Machine Learning, and AI are moving at such a pace that they now provide unique opportunities going forward.

Training• Takes training away from a tick box exercise to where data

drives evidence of performance.• By viewing training events as an experiment it empowers

innovation and development of new ways of working (down to the lowest level).

External• Ability to identify and quantify where innovation works –

rapidly capture new tactics for countering evolving threats.• Raises the level of individual and collective competence to

meet peer threats.


Chal lenges• Unless collective training and force development is aligned then the benefits cannot be

realised.

• The architectures that deliver future capabilities need to have built in the requirement for the

right data capture, interoperability of systems and clear methods for sharing of information.

• The commercial framework needs to allow for this exploitation, technically it can be achieved!

• Realising the benefit across defence for the data capture and not just for the specific training

system.

• Measurement of non-monetary benefits from training data exploitation.

• Cultural change in how we train.

Contact Detai ls

Chris Rolfs

Chief Technology OfficerTel: +44 (0)7932 649925

Email: [email protected]

Website: http://www.cervusdefence.com

mailto:[email protected]

http://www.cervusdefence.com/

cervus defence and security - t r a i n i n g d a t a e …...© cervus defence and security ltd...

Documents