nga demo participant collaboration dr. brand niemann director and senior enterprise architect –...

24
NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community http://semanticommunity.info/ AOL Government Blogger http://gov.aol.com/bloggers/brand-niemann/ March 23, 2012, and April 2, 2012 1

Upload: anne-millicent-simmons

Post on 04-Jan-2016

217 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

1

NGA Demo Participant Collaboration

Dr. Brand NiemannDirector and Senior Enterprise Architect – Data Scientist

Semantic Communityhttp://semanticommunity.info/

AOL Government Bloggerhttp://gov.aol.com/bloggers/brand-niemann/

March 23, 2012, and April 2, 2012

Page 2: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

2

March 23, 2012, Conference Call• OMG Meeting of Cloud Standards Customer Council:

– http://semanticommunity.info/AOL_Government/GSA_and_NIST_Need_the_Cloud_Standards_Customer_Council_to_Build_Trust_Between_Providers_and_Suppliers

• Geospatial Platform Key Documents:– http

://semanticommunity.info/Data.gov/GEOViewer/Geospatial_Platform_Key_Documents

• OGC Knowledgebase:– http

://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration/Open_Geospatial_Consortium

• Spreadsheet with OGC Knowledgebase and Haiti Data Sources:– http://semanticommunity.info/@api/deki/files/17585/=NCOICNGAOGC.xlsx

• Haiti Spatial Data:– http://geocommons.com/search?mh_query=haiti

Page 3: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

3

OMG Cloud Standards Customer Council Meeting

http://www.cloudstandardscustomercouncil.org/March2012/agenda-pr.htm

Kevin Jackson’sPresentation

Page 4: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

4

OMG Cloud Standards Customer Council Meeting

• Network Centric Operations Industry Consortium (NCOIC), Kevin Jackson, Chairman, NCOIC Cloud Computing Working Group:– NCOIC, A Global Industry Consortium– NCOIC Cloud Computing Working Group Charter– Lab Interoperability Project– Purpose– Cloud Computing Experiments– NGA Objectives– NGA User Scenario– NGA Request– NCOIC Member Participation– GITT Proposal– GITT Subgroups– Operational Viewpoint Community Cloud – Operational View Nodes and Roles– Current Status

http://www.cloudstandardscustomercouncil.org/March2012/Presentations/PDFs/jackson.pdf

Page 5: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

5

OMG Government DTF Meetings

http://semanticommunity.info/AOL_Government/A_Plan_for_Scaling_NIEM_to_Big_Data#Government_DTF_Agenda

My Presentation

13:00 – 17:30 Semantics and Ontologies for the Intelligence Community – Working toward Standards

Page 6: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

6

Semantics and Ontologies for the Intelligence Community – Working toward Standards Meeting

http://semanticommunity.info/AOL_Government/Semantics_and_Ontologies_for_the_Intelligence_Community_Working_Toward_Standards

Joe Rockmore Presentation on Data Integration

Page 7: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

7

Joe Rockmore Presentationon Data Integration

• Paradigm Shifts in the IC:– Ontology/ Data Model Then, and Knowledge Base

Now.– Search, Retrieve, Extract, and Analyze Then,

Versus Search, Facts, Analyze Facts, and Retrieve Data and Documents if Needed Now.

– Data Conditioned and Correlated (ETL) Then, Versus Data Integrated and Enhanced Now (Enhancements).

– Estimate 160M pieces of intelligence a day.

Page 8: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

8

Digital Reasoning SynthesysCloud Beta

• Mining (for people, places, and things) the Social Web, O'Reilly Books.

• Training Resources: API and Peruna Tutorials:– https://www.synthesyscloud.com/docs/training/

• GeoLocator from Digital Reasoning is a precision-based tool that will extract countries and populated places from unstructured text, while providing their respective geo-coordinates.

• Interceptor allows you the ability to look through all of your data rapidly and easily discover what is inside.

Page 9: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

9

Catalyst Entity Extraction and Disambiguation Study Functions

• Entity Extraction: MindTouch• Relationship Extraction: MindTouch• Semantic Integration: MindTouch, Excel, and Spotfire• Entity Disambiguation: MindTouch• Knowledge Base: MindTouch, Excel, and Spotfire• Visualization: Spotfire• Query: MindTouch and Spotfire• Analysis: Spotfire• Ontology/Data Model: Be Informed• Reference Data: MindTouch

My Example: CIA World Fact Book

Page 10: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

10

NCOIC March 26 and 30

• Collaboration:– NCOIC Member Inventory (did OGC first – see below)– OGC Knowledgebase (found GeoCommons for Haiti – see

below)• Use Cases and Data– GeoCommons for Haiti (new in April 19th dashboard)– Mining the Social Web During Disasters Has Become a Very

Important Source of Data!• Architecture– Catalyst Entity Extraction and Disambiguation Study Final

Report

Page 11: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

11

Red Cross Social Media Command Center

http://www.networkworld.com/news/2012/030812-dell-powers-red-cross-social-257082.html?source=NWWNLE_nlt_daily_am_2012-03-09

Terry Morgan, March 9th

Page 12: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

12

GeoCommons for Haiti

http://semanticommunity.info/@api/deki/files/17585/=NCOICNGAOGC.xlsx

Page 13: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

13

Updated Dashboard of Map, Metadata, and Knowledgebases

Web Player

Note: This dashboard is for both theon-the-ground responder and theintelligence analysts.The on-the-ground responder canannotate the number of personssent to hospitals and the intelligenceanalysts can update the data set andperform deeper analytics to helpadvise the officials on how to respond.

Page 15: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

15

Recorded Future: Web Site

https://www.recordedfuture.com/

Page 16: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

16

Recorded Future: Knowledgebase

http://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration#Recorded_Future

.

Page 17: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

17

Timeline Image ShowingJust the Momentum Curve

Shows how the intensity of coverage trailed off but didn't entirely die out even several months after the earthquake.

Recorded Future’s social data coverageis not so strong that far back so I asked that they look at blogs

Page 18: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

18

Timeline Image Including Event Icons

Page 19: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

19

Data Set That Includes Coverage from Sources Considered to be Blogs or Niche

http://semanticommunity.info/@api/deki/files/17712/=HaitiEarthquakeBlogandNiche-RecordedFuture03282012.xlsx

Page 21: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

21

Recorded Future Timeline:Haiti Disaster

Live Visualization Here

Page 22: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

22

Recorded Future Source Maps:Haiti Disaster

Page 23: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

23

Recorded Future Network:Haiti Disaster

Page 24: NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

24

Recorded Future Earth:Haiti Disaster