© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Multi-Source Data Analytics for

Intelligence Applications

Stéphan Brunessaux

Senior Expert Data Analytics

GLOBAL PREDICTIVE BUSINESS ANALYTICS & DATA MANAGEMENT FORUM Milan, Italy, 3rd February 2017

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

AIRBUS

THREE DIVISIONS, ONE BRAND

3 February 2017 2

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Defence and Space

Military Aircraft

• A400M

• A330 Multi-Role Tanker Transport

• Special Mission Aircraft

• Combat Aircraft

• Unmanned Aerial Systems

• Full In-Service Support

• Telecommunication Satellites

• Earth Observation Satellites

• Navigation Satellites

• Orbital and Space Exploration Infrastructure

• Science Missions

• Launchers, deterrence

• Earth Observation Satellite-based Geo-Intelligence Services

• Government Satellite Communication

• Command & Control (C5ISR) Systems

• Cybersecurity Solutions and Services

Space Systems Communications,

Intelligence & Security

3 February 2017 3

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Communications, Intelligence & Security (CIS)

Design Develop Deliver

Service

The business line Communications, Intelligence

& Security is the new one-stop shop for secure

communication solutions and intelligence and

security solutions for governments,

institutions and private business.

CIS is organised into three programme lines:

• Secure Communications

• Intelligence (including Geo-Intelligence)

• CyberSecurity

3 February 2017 4

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Actionable Intelligence for the Challenges of Tomorrow

Intelligence serve customers in more than 100 countries

Our customers operate in a wide range of market incl. Defence & Security,

Oil, Gas & Mining, Avionics, Forestry, Agriculture, Public Security, Civil

Engineering

We have access to 8 Earth observation satellites - 6 optical and 2 radar

satellites:

• Sentinel 2 : 10m earth image every 5 day, 5 PB per year, 10 TB / day

• Pleiades / Spot6/7: 2000 images 40 000 x 40 000 / day, ~1 500 000 full

HD images /day

Over 100 Billion km² of satellite imagery, archived since 1986

1.5 Billion people worldwide use our imagery every year.

3 February 2017 5

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

NEW INTELLIGENCE

SOURCES

- New technologies leading to new sources of intelligence

- Diversity of intelligence sources and formats

FULL CYCLE INTEGRATION

- Complete intelligence cycle - Integrated and versatile

INTEROPERABILITY

VOLUME OF

INFORMATION

- Huge volumes generated by new sensors & OSINT

- Handling and processing of Big data

- Between technologies - Cross echelons, between own

forces & coalitions

MULTI - INTELLIGENCE

CAPACITY

SIMPLIFICATION / SYNTHESIS

- Increasing asymmetric threat - Need to work cross domain to

combine intel

- Use of complex technology - Need for simplification &

Innovative visualisation

Our approach for multi-source Data Analytics

@

3 February 2017 6

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Support decision makers with data analytics

Support decision makers worldwide to increase defense and security, boost

performance, optimise mission planning and operations and improve

management of natural resources.

Provide analytics capabilities based on:

- Open Sources: Social Networks, Blogs, Forums, Websites, etc.

- Audio Sources: Speaker Identification, Speech-to-text, etc.

- Imagery: Change Detection, Element detection, Element counting (number

of aircrafts, number of cars), Target Detection, etc.

- Other sources

Typical use cases:

• Maritime surveillance based on AIS data, satellite imagery and open

sources,

• Farming optimisation using satellite imagery

• Social network analysis

3 February 2017 7

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

WebLab - our solution for Data Analytics applications

A flexible platform developed by Airbus for building Data Analytics

solutions

• Seamless integration of software components (search engine, information

extraction, translation, knowledge management, geographic

representation, etc.),

• Dedicated to all types of information (text, image, audio and video)

• Supporting a large variety of languages (occidental, oriental, etc.).

Particularly suited for the development of applications such as:

• Military Intelligence (HUMINT, COMINT, OSINT)

• Competitive Intelligence (Internet, Press, Commercial brochures, etc.)

• Management of multimedia archives (pictures, movies)

• Image and Media Crisis Intelligence (TV, Radio, Web, etc.)

• Customer Sentiment Analysis (Social Networks, Questionnaires, etc.)

• Social Network Analysis (Twitter, Facebook, LinkedIn, …)

• etc.

Main References

• Core of the Fortion Media Mining Defence solution

• French MoD, Interpol, MBDA, Airbus Defence and Space

• EDF, INA, BBC, Deutsche Welle, etc.

3 February 2017 8

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Overview of WebLab functionalities (1/2)

Data collection from

• Internet or Intranet

• Local or shared folder

• Radio / TV

• Databases

• Chat / IRC

• Social Networks

Text Pre-processing

• Text normalisation (PDF, Office,

Internet, etc.)

• Meta-data extraction

• Documents cleansing (advertisements,

etc.)

• Language Identification

Text Processing

• Named-entity extraction

• Geo-localisation

• Identification of entity relationships

• Text summarisation

• Opinion analysis

• Automatic Translation

.

Text indexing / retrieval

• Text and metadata indexation

• Plain, boolean, multilingual text

retrieval

• Semantic search

• Request suggestion

• Facets

• Alerts

Optical character recognition (OCR)

• Text recognition from scanned texts

• Text extraction from images

• Logo detection

Image processing

• Advanced image processing

• Visual concepts detection

• Visual similarity

• Face detection

Audio processing

• Identification of spoken languages

• Speaker recognition

• Audio segmentation / diarization

• Speech-to-text transcription

• Jingle detection

Video processing

• Key frames extraction

• Chaptering

• Advertisement detection

Indexation / multimedia retrieval

• Cross-media indexation

• Information retrieval by categories,

concepts, similarities, transcribed

keywords, etc.

• Search by visual content

Clustering / Categorisation

• Clustering of texts or multimedia

documents with similarities

• Automatic classification of documents

in pre-defined categories

Knowledge management

• Business ontologies

• Capitalisation of extracted information

• Use of knowledge for extraction,

classification, alerts

• Support to production of reports

3 February 2017 9

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Overview of WebLab functionalities (2/2)

Intelligence Report

3 February 2017 10

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

A Use case example:

Social Media Intelligence using WebLab

3 February 2017 11

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Defining sources where to collect information from.

12

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Typical dashboard for the Intelligence analyst

3 February 2017 13

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Search & Alert capabilities

3 February 2017 14

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Annotated Document Visualisation

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Automatic Translation capabilities

3 February 2017 16

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Speech Transcription

3 February 2017 17

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Twitter Exploitation View

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Statistics Indicators

3 February 2017 19

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Heat Maps and Geo-temporal Analysis

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Automatic Report Generation

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

Conclusion

• Data Analytics is revolutionising the way people work even in Defence and

Security. Shift of paradigm. From a need-to-know basis to a need-to-share basis.

Real challenge for people used to work in silos.

• The change of threats (assymetric threats, terrorism) makes necessary for Defense

and Security agencies the use of a multi-source intelligence approach and a

massive (automatic or semi-automatic) processing of all collected information to

detect and anticipate.

• Importance to have distributed capabilities on the operational field (theater

cloud) to allow real-time analysis and quick reaction despite possible limited

bandwidth capacity.

3 February 2017 22

Confidential

© 2

014 A

irbus D

efe

nce a

nd S

pace –

All

rights

reserv

ed. T

he r

epro

duction, dis

trib

ution a

nd u

tiliz

ation o

f th

is d

ocum

ent as w

ell

as the c

om

munic

ation o

f its c

onte

nts

to o

thers

without

expre

ss a

uth

orization is

pro

hib

ited. O

ffenders

will

be h

eld

lia

ble

for

the p

aym

ent of dam

ages. A

ll rights

reserv

ed in t

he e

vent of th

e g

rant of a p

ate

nt, u

tilit

y m

odel o

r desig

n.

The reproduction, distribution and utilization of this document as well as the communication of its contents to others without

express authorization is prohibited. Offenders will be held liable for the payment of damages.

All rights reserved in the event of the grant of a patent, utility model or design.

For more information, please contact:

Stéphan Brunessaux Senior Expert Data Analytics

Studies and Innovative Concepts (TCIEC)

Communications, Intelligence, Security

T +33 (0)1 61 38 70 55 Airbus Defence and Space

F +33 (0)1 61 38 57 19 1 Bd Jean Moulin – CS40001

E stephan.brunessaux@airbus.com 78996 Elancourt Cedex

www.airbusdefenceandspace.com France

3 February 2017 23