development of computerized support tools for intelligence ...development of computerized support...

33
Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian Mårtenson, Pontus Svenson Swedish Defence Research Agency [email protected]

Upload: others

Post on 05-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Development of Computerized Support

Tools for Intelligence Work

Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian Mårtenson, Pontus Svenson

Swedish Defence Research [email protected]

Page 2: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Outline

Review of the intelligence businessExamples of tools to be included in a toolbox to be used by the intelligence analystThe presentation contains some preliminary work, but at the core is the vision of an intelligence toolbox—which is work to be done

ToolboxToolboxFile Edit View Navigate Window Tool Help

Tools

Report Organization andVizualisation

Text Analysis

Strategic Awareness Assistant

Summarization

Threat Scenarios

Impactorium

Situation Picture Assistant

Social Network Analysis

Attack AnalyserAttack Analyser

Impactorium

Repost Organisationand Vizualisation

Social Network Analysis

Threat Scenarios

Text Analyser

Situation Picture Assistant

Summarization

Stategic Conflict AnalyserReport Organization and

Visualization

Page 3: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Acknowledgement

Presentation material obtained from:the intelligence research project at the National Defence College (via Per-Arne Persson),the 2008 Swedish Armed Forces intelligence doctrine (via Mårten Frambäck),colleagues at FOI,…and probably more.

Thanks!

Page 4: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Intelligence work: deliver basic data for decision-making to commanding officer

Page 5: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

The intelligence service is both the organization and the activity producing intelligence products that describe, explain and predict “non-own” phenomena.

The intelligence service

Own Neutral Hostile Unknown/Other

Intelligence service responsibility

Page 6: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Weekly meetingsTargetingReflection

“Intelligence-internal” RFIs

Intelligence Management Plan (Br.)Daily Asset Reconnaissance Board

The intelligence cycle and its context

Page 7: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

The ISTAR-concept: a view taken by current Swedish research efforts

Sensor control (tasking)

Heterogeneity- Sensor status- Report data

Automation?Fusion technology?

Analysts value, interpret,produce

StoreRetrieval

Data base

Sensors

MethodsTools

Page 8: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

There is a new era in the intelligence businessWhat kind of support should we develop?When is automation possible?And to what extent?

Page 9: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Intelligence regulations from the 1980’s: what can automation do?

Page 10: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian
Page 11: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Intelligence workflow

Searching

AnalysisInput/structuringPresentation

Computer aided

Today

Automation

Time spent [%]

Time critical

Page 12: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Information fusionJDL-model

Multi-sensor fusionSituation assessmentImpact assessmentAdaptation

Role to support intelligence analysis processTools that help humans sort, filter, fuse information and data

Page 13: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Mixed-initiative

Techniques for taking advantage of human and computer advantages synergisticallyIncreased interaction

Human provides experience and intuitionComputer provides processing power and memory

Page 14: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Blackboard architecture

Page 15: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Tools

Page 16: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Report organization and visualization

ToolboxToolboxFile Edit View Navigate Window Tool Help

Report Organization andVisualization

Text Analysis

Strategic Awareness Assistant

Summarization

Threat Scenarios

Impactorium

Situation Picture Assistant

Social Network Analysis

Attack Analyser

File Edit Tools Databases

Demonstration central city 1/mar/08 1/mar/08 12:47Demonstration at central city- 200 – 300 persons- Aggressive atmosphere- caught sight of weapons

Report Organization and Visualization

Bombing at Foo square 2/mar/08

Page 17: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Impactorium

Impactorium

Page 18: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Three componentsCreate model Associate reports to indicators Compute and display results

Page 19: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Hypothesis management

Analysts need tools that allow them to visualise their hypotheses about the futureCollaborative toolsEasy to visualise movementsHow to visualise more complicated intelligence analyses

Page 20: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Semantically tagging information by extracting knowledge from data

Semantic tagging will be a major part of analysts’ work in the future

Social networks, RDF triples, semantic wikis,…

Automating (parts of) this work would be goodEntity extraction can be used to present a list of entities to the analystMore challenging: present relations between entities (in possibly different documents)

Page 21: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Entity extractionToolboxToolbox

File Edit View Navigate Window Tool Help

Report Organization andVizualisation

Text Analysis

Strategic Awareness Assistant

Summarization

Threat Scenarios

Impactorium

Situation Picture Assistant

Social Network Analysis

Attack Analyser

Text Analysis

Report Organization andVisualization

File Edit Tools Databases

Page 22: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Case-based reasoning crash course

Look at current situationFind similar previously encountered situations in case databasePresent most similar case(s) to user, if possible adapt solution to current case

Defining “similar” is difficult…

Page 23: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Tools based on case-based reasoningThreat model construction assistant

Fusion tools need modelsIdea: use CBR to help analysts create models by letting the cases correspond to “situations”Situations can be described by the currently relevant parameters in, e.g., a probabilistic model

Situation picture construction assistantThe needed views, services, etc., changes from person to person and from time to timeIdea: help analysts to select the appropriate view using CBR

Page 24: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Threat model construction

Threat Scenarios

Page 25: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Situation picture constructionToolboxToolbox

File Edit View Navigate Window Tool Help

Report Organization andVizualisation

Text Analysis

Strategic Awareness Assistant

Summarization

Threat Scenarios

Impactorium

Situation Picture Assistant

Social Network Analysis

Attack Analyser

Situation Picture Assistant

CrowdLargeAggressiveWeapons

Related

Information

Reports

Location

Save

Zoom

Actions

New map

Actions

Map

Report Organization andVisualization

Page 26: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Social network visualization and analysis

Attack president

StabbShoot

Knife Close locationGun Nearby location

Work in P:s staffWork where P

goes

Hairdresser Restaurant

By knife

Gym

Social Network Analyser

Page 27: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Social network analysis: ultimately an interactive support tool with possibility to acquire data automatically at the discretion of the analyst

Page 28: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Attack tree assistantToolboxToolbox

File Edit View Navigate Window Tool Help

Report Organization andVizualisation

Text Analysis

Strategic Awareness Assistant

Summarization

Threat Scenarios

Impactorium

Situation Picture Assistant

Social Network Analysis

Attack Analyser

Attack president

StabbShoot

Knife Close locationGun Nearby location

Work in P:s staffWork where P

goes

Hairdresser Restaurant

By knife

Gym

Attack Analyser

Tree

Analyze

Save

New

Draw

Related

Possibilites

Min/Max

Cost

Cost

Countermeasure

Add

Suggest

Report Organization andVisualization

Page 29: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Strategic awareness assistantToolboxToolbox

File Edit View Navigate Window Tool Help

Report Organization andVizualisation

Text Analysis

Strategic Awareness Assistant

Summarization

Threat Scenarios

Impactorium

Situation Picture Assistant

Social Network Analysis

Attack Analyser

File Edit Tools Databases

Actors Coars of Action

Assessment

Strategic Awareness Assistant

Report Organization andVisualization

Page 30: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Strategic and tactical intelligence

Need for strategicawareness

Need for tacticaldata processingand visualization

Page 31: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

Strategic awareness in practice according to intelligence expertise

Estimate possible courses of actions:Actor A can perform actions A1, A2, A3Actor B can perform actions B1, B2, B3Actor C can perform actions C1, C2, C3

Judge what will happen given some action:A1 => B3, C2…

The judgments result in 3–5 scenarios that are used for further discussion using cognitive decision making principles:

What scenario is the most dangerous one?What scenario is the most probable one?…

Page 32: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

A game-theoretic assistant for strategic awareness

GUI letting the analyst:List actors (including nature), available courses of actions, and possible outcomesEstimate probabilities for outcomes

Algorithms helping out with:Probability calculationsStrategic awareness in the form of equilibria taking opposing actors into account

VisualizationRequires user experiments and creative solutions

Page 33: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian

The end…

Questions?

[email protected]