network centrality in sub-national areas of interest using gdelt data
DESCRIPTION
USMA Cadet leverages GDELT Global Knowledge Graph (GKG) to quantify global human society beyond cataloging physical occurrences and network structure of the global news.TRANSCRIPT
![Page 1: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/1.jpg)
The Power of Partnership – from Vision to Reality
NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA
11 July 2014 CDT Caitlin Rowe
![Page 2: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/2.jpg)
Introduction
• Caitlin Rowe • Senior at United States Military
Academy • Studying Systems Engineering
Senior Project/Capstone with Data-Tactics for AY15 !!• Goals for 3 week summer
internship • Make connections for help during
academic year • Learn how to use Shiny • Explore GKG data for Dhaka, Bangladesh • Explore the utility of subnational
analysis2
![Page 3: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/3.jpg)
Agenda
• Data Analytics in the Military
• Familiarization with GKG
• Network Centrality Analysis for Military Application
• GDELT Analysis Service
• Shiny and Gephi Results
• Communicating Conclusions to Military Leadership
• Future Areas for Improvement
3
![Page 4: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/4.jpg)
Data Analytics in a Military Context
• Technological advances • Vast amounts of data • Sensors • Social Media Sites • HUMINT
!• Used to increase • Efficiency • Accuracy
4
![Page 5: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/5.jpg)
Data Analytics in a Military Context
5
“Simply put, big data is now a fixture on the battlefield and across the global security landscape.” -Forbes
http://www.forbes.com/sites/techonomy/2012/03/12/military-intelligence-redefined-big-data-in-the-battlefield/
![Page 6: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/6.jpg)
My Research
• Guidance from project advisor • GDELT • Global Knowledge Graph • Dhaka, Bangladesh
6
• Purpose for Research • Assess GKG at subnational
level • Determine influential
individuals and organizations !
![Page 7: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/7.jpg)
Familiarization with Dataset
• Global Knowledge Graph • Date, Event, People,
Location, Tone, and Article(url)
7
• Collected from web, print, and broadcast news sources
![Page 8: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/8.jpg)
Network Centrality for Military Application
8
• Identify leadership and key players in given area
• Friendly and Enemy
• Which centrality measure is the most important in a military operation?
• Degree
• Closeness
• Betweenness
![Page 9: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/9.jpg)
GDELT Analysis Service
9
GDELT.org Analysis Service
Email containing analysis ex.filtered data, graph, map
Email address Date range Key words
![Page 10: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/10.jpg)
GDELT Analysis Service
• GKG Network
• Heat map
• Exporter
• Geographic Network
• Word Cloud
10
![Page 11: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/11.jpg)
GDELT Analysis Service- GKG Network
11
![Page 12: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/12.jpg)
Important Nodes
12
![Page 13: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/13.jpg)
Shiny
13
Filter using R and
create a network (igraph)
All GKG raw data (downloaded)
Create Shiny App that displays network, nodes, and centrality measures
![Page 14: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/14.jpg)
Current Static Network
14
![Page 15: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/15.jpg)
Gephi
15
Filter using R and
create a network (igraph)
All GKG raw data (downloaded)
Export network as “.graphml” file
Open network in Gephi and explore using built in tools
![Page 16: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/16.jpg)
Gephi Network Example
16
![Page 17: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/17.jpg)
Gephi Network Example
17http://webatlas.fr/tempshare/ForceAtlas2_Paper.pdf
![Page 18: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/18.jpg)
Conclusions
• Efficiency • The GKG Analysis Tools, Gephi, and Shiny all
produce network visualizations that display network centrality. These results can aid military leaders’ decisions of who to target or exploit based on specific mission information.
• Accuracy • All of the network information is gathered from
news sources, so connections between individuals that are clandestine or informal might not be included.
18
![Page 19: NETWORK CENTRALITY IN SUB-NATIONAL AREAS OF INTEREST USING GDELT DATA](https://reader034.vdocuments.us/reader034/viewer/2022042423/53ed63e08d7f7289708b5c51/html5/thumbnails/19.jpg)
Future Areas of Improvement
• Shiny App • Change city, date range • Separate by community • Gephi • More seamless transition from R • Overall • Remove newspaper editors
19