ontological considerations for uncertainty propagation in high …stids.c4i.gmu.edu › papers ›...

12
Where Innovation Is Tradition Ontological Considerations for Uncertainty Propagation in High Level Information Fusion Mark Locher Paulo C. G. Costa Semantic Technologies for Intelligence, Defense, and Security 2012

Upload: others

Post on 03-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Ontological Considerations for Uncertainty Propagation in High Level Information Fusion

Mark Locher

Paulo C. G. Costa

Semantic Technologies for Intelligence, Defense, and Security 2012

Page 2: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition 2

Introduction

❖ Data explosion increases information fusion needs and

opportunities

v Uncertainty pervades fusion

❖  Information fusion divided into   Low level: entity oriented, uncertainty reasonably understood   High level: relationship oriented – emphasis on symbolic techniques

v Multiple techniques for representing / assessing / uncertainty; no consensus on how to compare techniques

v Need to systematize understanding of where / how uncertainty occurs and interacts in a high level fusion process

Page 3: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition 3

Outline

❖  Fusion Level Definition

❖  Level 2 HLIF taxonomy

❖  Fusion model

❖ Uncertainty in fusion   Input (data) uncertainty   Representation uncertainty   Process uncertainty   Output uncertainty

❖ Conclusion

Page 4: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Fusion Level Definitions

Modified Joint Directors of Laboratories (JDL) model

4

Level Title Definition 0 Signal / Feature

Assessment Estimate signal or feature state.

1 Entity Assessment

Estimation of entity parametric and attributive states (i.e. of entities considered as individuals)

2 Situation Assessment

Estimate the structures of parts of reality

3 Impact Assessment

Estimate the utility/cost of signal, entity or situation states, including predicted utility / cost given a system’s alternative courses of action

4 Process Assessment

A system’s self-estimate of its performance as compared to desired states and measures of effectiveness.

Low Level

High Level

Page 5: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Creating a Level 2 HLIF Taxonomy: Sowa’s Ontology

5

Physical Abstract Continuant Occurrent Continuant Occurrent

Independent Object Process Schema Script Relative (Few /

Focused) Juncture Participation Description History

Mediating (Many /

Interacting)

Structure Situation Reason Purpose

Types of Entities

Rel

atio

nshi

ps b

etw

een

Entit

ies

v Viewpoint matters – Airplane both an object and a structure

v Timescale matters – Ice cube as continuant and occurent

Level 2

Level 1

Page 6: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Taxonomy of Level 2 HLIF Types

6

Specific Situation / Structure (S/S) Known

Entity Level Focus

Determine 9/11

Planning

S/S Level Focus

1. Refinement of Entity Attribute

Scripts / Schemas Emphasis

Description / History

Emphasis

No

Choice Among Well-Defined S/S Options

Reason / Purpose Choice Definition

S / S Development

Selection among Choice /

Integration of Fragments

5. S / S Creation

Well-Defined Scripts / Schema /

Descriptions / Histories

4. S/S Refinement

2. Entity Selection

3. S/S State Selection

Increasing Complexity

Examples Develop Order of Battle; Determine Purpose of Factory

Military I&W Identify Smuggling Ship

Determine SAM Present

Yes

Page 7: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Level 2 Fusion Process Model

7

Fusion

Level 3 Fusion

Level 2 Data

Object A Level 1 Fusion

Object N Level 1 Fusion

Level 1 Data

Level 0 Data Level 0 Data

……

Level 3 Data

Data Alignment

Evidence Extraction

Level 2 Level 2 Conclusions

Data Store

Uncertainty Areas

v  Input (data) Uncertainty

v  Representational Uncertainty

v  Process Uncertainty

v  Output Uncertainty

Page 8: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Input (Data) Uncertainty

8

Conclusion

Reasoning Step 1

Reasoning Step N

Event E

SAM System will engage a

target

SAM Systems are located with

the radar

If SAM radar is active, then

SAM is preparing to

engage

SAM Radar active at Location X

Intermediate Reasoning

Steps

Conclusion

Evidence E*

Event E

Force / Weight

Credibility

Data

Relevance

Reasoning Steps

Veracity Objectivity (Bias) Observational Sensitivity Self Report

Basic Reasoning Steps Uncertainty in the Data

Page 9: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

v  Uncertainty Derivation   Objective   Subjective

v  Uncertainty Type   Aleatory   Epistemic

v  Uncertainty Model   Bayesian   Dempster-Shaffer   Possibility Theory   Imprecise Probability   Random Set Theory   Fuzzy Theory / Rough

Sets   Interval Theory   Uncertainty Factors

v  Uncertainty Nature   Ambiguity   Empirical

–  Random

  Vagueness   Incompleteness   Inconsistency

Representation Uncertainty

9

Page 10: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Process Uncertainty

10

Fusion

Level 3 Fusion

Data Alignment Errors (Representational) Object A

Level 1 Fusion

Object N Level 1 Fusion

……

Data Alignment

Evidence Extraction

Level 2

Data Store

Inaccuracies / Incompleteness (Process)

Extraction Errors (Data Uncertainty)

Conclusion

Fusion Model Uncertainties (Process / Representational)

Page 11: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Output Uncertainty

v Completeness of the hypothesis set   Open versus closed world assumptions

11

Page 12: Ontological Considerations for Uncertainty Propagation in High …stids.c4i.gmu.edu › papers › STIDSPresentations › STIDS2012... · 2012-10-23 · Ontological Considerations

Where Innovation Is Tradition

Conclusion

v Uncertainty In the Fusion Process Model

12

Fusion

Output

Representation Uncertainty

Data

Data Uncertainty (relevance, credibility)

Output Uncertainty

Data Alignment

Evidence Extraction

Level 2

Data Store

Process Uncertainty

Data Uncertainty (Force / Weight)

Representation Uncertainty

Level of Complexity