Working Group IIIMulti-National

Experimentation

19 Dec 2002

Task 1 How to Apply NCW/NEC Conceptual Framework to Experimentation

IF Group 1/2 agree that the Framework is acceptable

AND it survives detailed scrutiny once the Nations get it home

AND we can identify areas of common agreement

AND we can agree how we will manage and develop it

THEN The Framework should be used as a basis for developing multinational experiments and sharing information on national experiments

Sweden

Experimentation

Capability

ResearchAcquisition

Experimental Cooperation

Experimentation

Capability

ResearchAcquisition

UK

Australia

Experimentation

Capability

ResearchAcquisition

US

Experimentation

Capability

ResearchAcquisition

** National imperatives will differ

Framework Use• Basis for:

– Sharing information on national experiments– Developing multinational experiments– Recording the scope, design, limitations etc

of experiments (eg associated metrics) – Instrumenting reality– Developing a common ontology

Task 2

• What benefits are derived from a Multinational Experimentation Campaign?

• What downsides and challenges exist in conducting multinational experiments?

• How can we implement metrics into these campaigns?

Task 2 Benefits

• Risk reduction for Multinational Operations

• Identifies solution sets to interoperability issues

• Increases understanding of other nations culture and DOTMLPF issues

• Increases the probability of execution when multiple nations have bought in

• Furthers shared understanding of NCW/NEC/etc. operations

• Promotes a shared understanding of Experimental Techniques

– Metrics– Experimental Design– Analytical techniques– Data treatment

• Reduce the individual countries costs and increase the efficiency

• Furthers shared understanding of NCW/NEC/etc. operations

• Promotes a common knowledge base of Experimental Techniques

– Metrics– Experimental Design– Analytical techniques– Data treatment

• Allows for leveraging of national efforts• Broadens the base for peer review of

results• May result in faster requirements to

solutions cycle• Allows for early identification of like

efforts and facilitates collaboration

Multinational Experiments Shared Information on National Experiments

Task 2 Downsides/Challenges

• National imperatives will differ• It is Expensive• IT is PAINFUL

– Politically VERY Difficult– Compromise on objectives – System Engineering efforts

are more difficult– Security Issues– Level of military effort

necessary to do scenario, etc.– Single scientific lead is

necessary • No persistent environment• Decreases flexibility to

respond to emergent events

• Determining what to share increases the work for experimentation

• May result in a competitive advantage to others

• Increase the costs of meta-data organization w/o direct benefit to individual projects

• Increased opportunity for security leaks

Multinational Experiments Shared Information on National Experiments

Task 3 Implementation Recommendations

• For the Conceptual Framework– Continue to develop the framework and coordinate it among the

experimentation communities of the various nations• Add narrative to support the framework• Continue to develop scenarios• Recommend that the BOD include appropriate multinational participation

– Make the framework openly available to those who want to participate in multinational experimentation activity

• For Application to National and Multinational Experimentation– Use the framework to provide a basis for the conduct of national

experimentation campaigns.– Use of the framework will facilitate synergism among national campaigns.

• Some means of multinational configuration management of the framework will be necessary to accomplish this

– Consistently use the ontology/relationships in the Framework to facilitate knowledge sharing among participating nations

• that is reusable.• Use the terms, measures, influences, metrics, and interrelationships, (and

other stuff) described in the framework to document experiments, in order to allow them to be compared and combined.

Task 3 Implementation Recommendations (cont)

• For LOE-2– Encourage participation of Framework team in LOE-2

• Map LOE metrics to the framework as possible – Consider using LOE-2 data (post experiment) to populate a case

study– Engage early in LOE-3… planning for more substantive use of the

framework in the analytical effort• Expand existing opportunities for multinational cooperation in

exercises, demonstrations, experiments.– Investigate and document technical and functional interoperability

solutions as part of the output of these efforts.– Investigate and document co-operability solutions as part of the

output of these efforts.

Questions

Backups

National Imperatives for Experimentation will Differ

• UK (Benefits of NEC are a given) – NEC is an enabler not a concept– Develop requirements for systems– Co-evolve all lines of development (DOTMLPF)

• US– Assess benefits of NCW– Refine Concepts of Operations– Help Guide Investment

• SW– Size of Defense Budgets

Products

• Recommended adds to LOE-2?• What is the realistic scope of a cooperation in a

MN experimentation campaign? And how should we cooperate?

• Identify the different campaigns that are underway or envisioned and their overlaps.

• What are the major components of a NCW Experimentation Campaign?

• National Perspectives on Big Picture Perspective of NCW Experiments

• Shared Results/Data Opportunities

Multinational Experimentation Campaign Objective

• To conduct a series of experiments• Develop shared understanding of each others military modus operandi• Resolve key issues that achieve interoperability/co-operability• Experiment and resolve those issues incrementally culminating in a combined joint experiment which will demonstrate our ability to conduct both national and multinational operations. (Experiments must look at all lines of development (DOTMLPF))